As an increasing demand of advanced nuclear fission reactors and fusion facilities, the key
requirements for the materials used in advanced nuclear systems should encompass …

A big convergence of language, multimodal perception, action, and world modeling is a key
step toward artificial general intelligence. In this work, we introduce KOSMOS-1, a …

We introduce phi-3-mini, a 3.8 billion parameter language model trained on 3.3 trillion
tokens, whose overall performance, as measured by both academic benchmarks and internal …

This paper presents our recent work on the design and development of a new, large scale
dataset, which we name MS MARCO, for MAchine Reading COmprehension. This new …

Pretrained general-purpose language models can achieve state-of-the-art accuracies in
various natural language processing domains by adapting to downstream tasks via zero-shot, …

We introduce a large scale MAchine Reading COmprehension dataset, which we name MS
MARCO. The dataset comprises of 1,010,916 anonymized questions---sampled from Bing's …

The production, characterization, and antioxidant capacity of the carotenoid fucoxanthin from
the marine diatom Odontella aurita were investigated. The results showed that low light and …

• Carbon (C) and water cycles of terrestrial ecosystems are two coupled ecological processes
controlled partly by stomatal behavior. Water‐use efficiency (WUE) reflects the coupling …

Position modeling plays a critical role in Transformers. In this paper, we focus on length
extrapolation, ie, training on short texts while evaluating longer sequences. We define attention …

In this work, we present an information-theoretic framework that formulates cross-lingual
language model pre-training as maximizing mutual information between multilingual-multi-…