Skip to content

Research separate from news

What could become important next

A preprint is a signal, not a finished product or an independently confirmed result. We therefore track research papers separately and show the actual state of supporting evidence for each one.

846 published research events

Latest work

A significant claim from a single source is published only after further confirmation.

Research only one source so far

Causal dependence vs. attention: how to train sparse attention correctly in transformers

A study finds that attention patterns (where a model looks) differ from causal dependence (what its decisions depend on). Sparse attention trained on attention achieves 41 % accuracy, while training on evidence achieves 99 %. The problem also appears in pretrained models: Gemma-2-9B improved from 56 % to 99 % accuracy when it was…

arXiv cs.LG (Machine Learning) Original source ↗
Research only one source so far

Neural Atom Prevalence: A Bayesian method for neural network compression

A research paper introduces Neural Atom Prevalence (NAP), a Bayesian framework for structured neural network compression. The method reduces active nodes to 8 % of the original architecture on MNIST while retaining accuracy and providing calibrated uncertainty estimates (93.4 % coverage against a 95 % target).

arXiv cs.LG (Machine Learning) Original source ↗
Research only one source so far

Dynamic commonsense coordination for generating empathetic responses

DCC, a research framework for generating empathetic responses, improves commonsense coordination through three modules (SCE-AttnRes, AGCF, ICAD). On Empathetic-Dialogues, it achieved higher emotion classification accuracy and better response diversity than the CEM baseline.

arXiv cs.CL (Computation and Language / NLP) Original source ↗
Research only one source so far

Stable quantum federated learning for intelligent services

An arXiv research contribution proposes DUQFL-Prox, a framework for quantum federated learning. It aims to address instability and unfair performance between clients in heterogeneous distributed environments without sharing local data. Experiments on fraud detection and genomic classification show improved stability and…

arXiv cs.LG (Machine Learning) Original source ↗
Research only one source so far

Multi-agent system-driven digital twins for predictive maintenance: Architectures, technologies and open research questions

A systematic review of 547 scientific articles analyzes the intersection of Multi-Agent Systems and Digital Twins focused on predictive maintenance in industry. The study identifies three main open research questions: deploying AI on resource-constrained microprocessors, distributed coordination through lightweight communication protocols and…

arXiv cs.AI (Artificial Intelligence) Original source ↗
Research only one source so far

The Hard Decision Layer: How transformers commit to predictions

Research identified a phenomenon in transformers where models abruptly commit to answers at a particular layer — the Hard Decision Layer (HDL). Tests on four models (Qwen, Llama, Granite, Mistral) and four datasets showed consistent HDL emergence without learned routing strategies. On…

arXiv cs.CL (Computation and Language / NLP) Original source ↗
Research only one source so far

TRACTA benchmark for temporal reasoning in complex systems

The article introduces the TRACTA benchmark with three tasks (early warning, pattern detection, run classification) for testing temporal reasoning in event-driven systems. Neuro-symbolic models working with semantically grounded trajectories achieved the best results compared with purely…

arXiv cs.AI (Artificial Intelligence) Original source ↗
Research only one source so far

Robust smart prediction with optimization

A research paper proposes a method for robustly integrating forecasting and optimization that accounts for data bias in feature space. It establishes theoretical guarantees of exponential decay in approximation error and experimentally shows improvements over standard methods.

arXiv cs.LG (Machine Learning) Original source ↗
Research only one source so far

Detecting depression on social media using language model embeddings

Research compares large language models and traditional classifiers for depression detection. LLMs dominated binary classification but lagged in severity prediction. Supervised models trained on LLM summary embeddings were more accurate, particularly for multiclass classification.

arXiv cs.CL (Computation and Language / NLP) Original source ↗
Research only one source so far

Variance-reduced distributed Q-learning in changing networks

A research paper introduces VRDQ, an algorithm for multi-agent reinforcement learning over distributed networks. Agents share information about the Bellman operator and achieve linear speedup through collaboration with minimal communication overhead.

arXiv cs.LG (Machine Learning) Original source ↗
Research only one source so far

Evaluation-as-a-Service architecture: a microservices approach to AI evaluation with coverage guarantees

A scientific paper describes an Evaluation-as-a-Service architecture with six Kubernetes microservices for AI evaluation. It combines conformal prediction, fairness monitoring, and drift detection. Validation: empirical coverage at the target level, 100% drift detection power, and latency below 2ms for a batch of 100.

arXiv cs.LG (Machine Learning) Original source ↗
Research only one source so far

Quasi-Monte Carlo initialization for meta-reinforcement learning

A research paper examines quasi-Monte Carlo weight initialization for meta-reinforcement learning. It shows improved training convergence on similar unseen tasks compared with orthogonal defaults (SB3), but the orthogonal method performed better on dissimilar tasks.

arXiv cs.LG (Machine Learning) Original source ↗