Can decentralized algorithms outperform centralized algorithms? a case study for decentralized parallel stochastic gradient descent
Most distributed machine learning systems nowadays, including TensorFlow and CNTK, are
built in a centralized fashion. One bottleneck of centralized algorithms lies on high …
built in a centralized fashion. One bottleneck of centralized algorithms lies on high …
A hybrid MLP-CNN classifier for very fine resolution remotely sensed image classification
The contextual-based convolutional neural network (CNN) with deep architecture and pixel-based
multilayer perceptron (MLP) with shallow structure are well-recognized neural …
multilayer perceptron (MLP) with shallow structure are well-recognized neural …
: Decentralized Training over Decentralized Data
While training a machine learning model using multiple workers, each of which collects data
from its own data source, it would be useful when the data collected from different workers …
from its own data source, it would be useful when the data collected from different workers …
Flexgen: High-throughput generative inference of large language models with a single gpu
The high computational and memory requirements of large language model (LLM) inference
make it feasible only with multiple high-end accelerators. Motivated by the emerging …
make it feasible only with multiple high-end accelerators. Motivated by the emerging …
UNetFormer: A UNet-like transformer for efficient semantic segmentation of remote sensing urban scene imagery
Semantic segmentation of remotely sensed urban scene images is required in a wide range
of practical applications, such as land cover mapping, urban change detection, …
of practical applications, such as land cover mapping, urban change detection, …
The role of the Grb2–p38 MAPK signaling pathway in cardiac hypertrophy and fibrosis
…, C Weinheimer, M Courtois, A Kovacs, CE Zhang… - The Journal of clinical …, 2003 - jci.org
Cardiac hypertrophy is a common response to pressure overload and is associated with
increased mortality. Mechanical stress in the heart can result in the integrin-mediated activation …
increased mortality. Mechanical stress in the heart can result in the integrin-mediated activation …
Holistic evaluation of language models
Language models (LMs) are becoming the foundation for almost all major language
technologies, but their capabilities, limitations, and risks are not well understood. We present …
technologies, but their capabilities, limitations, and risks are not well understood. We present …
Brain-region-specific organoids using mini-bioreactors for modeling ZIKV exposure
Cerebral organoids, three-dimensional cultures that model organogenesis, provide a new
platform to investigate human brain development. High cost, variability, and tissue …
platform to investigate human brain development. High cost, variability, and tissue …
Advances, challenges and opportunities in creating data for trustworthy AI
As artificial intelligence (AI) transitions from research to deployment, creating the appropriate
datasets and data pipelines to develop and evaluate AI models is increasingly the biggest …
datasets and data pipelines to develop and evaluate AI models is increasingly the biggest …
Deja vu: Contextual sparsity for efficient llms at inference time
Large language models (LLMs) with hundreds of billions of parameters have sparked a new
wave of exciting AI applications. However, they are computationally expensive at inference …
wave of exciting AI applications. However, they are computationally expensive at inference …