Microsoft

Analog optical computer for AI inference and combinatorial optimization

Artificial intelligence (AI) and combinatorial optimization drive applications across science and industry, but their increasing energy demands challenge the sustainability of digital computing. Most ...
GitHub

Global Balanced Pipeline Parallelism System for Distributed LLM Serving with Token Throttling

python -m gllm.entrypoints.api_server --port $PORT --master-port $MASTER_PORT \ --model-path $MODEL_PATH --pp $PP --launch-mode master --worker-ranks $RANKS To launch ...
IEEE

Temporal Convolutional Network-Based Spatiotemporal Modeling Method for Distributed Parameter Systems

Spatiotemporal modeling for distributed parameter systems (DPSs) described by partial differential equations (PDEs) is challenging due to infinite dimensional nature and strongly nonlinear ...
IEEE

Toward Temporal Efficient Spiking Neural Network via Dynamic Training and Inference

Abstract: Spiking Neural Networks (SNNs) have emerged as a promising alternative to traditional Artificial Neural Networks (ANNs) due to their biological interpretability. SNNs process input ...