🧠

Artificial Intelligence

Explore the latest in machine learning, deep learning, natural language processing, and AI applications

13526
Total Items
8123
Papers
935
Videos
60
Books
3802
Blogs
396
News
85
Podcasts
82
GitHub
2
Q&A
Browsing by date

Navigate through content by publication date

Wed, Aug 19

42 items found

1 of 319
📄 paper

Evaluating and improving crop-yield forecasting methods during extreme drought

The impact of climate variability on food production has led to the creation of various forecasting models that uses machine learning (ML), numerical weather predictors (NWP) or a hybrid of ML-NWP models to identify structural and physical relationships between meteorological drivers and crop growth, in order to predict crop yield. Droughts, for example the 2012 Midwestern US (Corn Belt) drought, are extreme events that affect crop production and test the limits of these forecasting models. Using 16 meteorological drivers as predictors, we compare ML (non-deep learning) and deep learning forecasting models to predict the county-level corn yield for the extreme drought year, 2012. This forecasting problem is characterized by a dissimilarity between the feature distributions of the training and test data, where the meteorological conditions of the extreme drought year fall outside the range of historically observed values. Additionally, the dataset consists of spatial and temporal irregularities where counties with missing yields introduce spatial sparsity and the use of only a subset of daily values per year introduce temporal sparsity. To overcome this, we use sample weighting and feature selection as modifications to improve our forecasting models. These modifications lead to an improvement for ML models; however, the deep learning model VITA shows little to no improvement. While VITA outperforms the ML models with or without modifications, our current study sheds light on the effect of dissimilarity between train and test feature distributions on forecasting models, compares deep learning versus non-deep learning models, and introduces modifications that are effective for non-deep learning models.

AI advanced Machine Learning
By: Shrey Gupta, Yi Ming, George Mohler
Source: arXiv Aug 18, 2026
0.0
10 min read
0
Quality
📄 paper

Against Political Polarization: A Unified Framework for Tracing Evolving Political Ideologies on Social Media

The rapid growth of social media has greatly influenced political discourse, highlighting the need to understand individual political ideologies and their temporal dynamics. This task faces challenges such as data scarcity, abundant non-political content, costly and bias-prone manual annotation, and difficulty in modeling future ideological inclinations. To address these issues, we propose TSN4PI, a unified framework for tracking the evolution of political ideologies on social media. It includes two core modules. The PIDN uses large language models with style transfer and unsupervised domain adaptation to enable robust ideology detection and filter irrelevant content from noisy, cross-domain data. The PIPN employs temporal graph neural networks to predict future ideological shifts, enabling comprehensive analysis of ideology presence, intensity, and evolution. We release two large-scale datasets for noncommercial research use to facilitate further work. Extensive case studies on multiple platforms (X and Truth Social) validate the effectiveness of TSN4PI and provide empirical insights into political polarization and the evolution of online ideologies. Our findings offer a nuanced perspective, advancing both methodological development and empirical understanding in this field.

AI advanced Artificial IntelligenceNatural Language Processing
By: Yijie Xu, Chao Wang, Hui Xiong
Source: arXiv Aug 18, 2026
0.0
5 min read
0
Quality
📄 paper

Composing Flow-Matching Energies with Known Physics: Generation, OOD Detection, and Inversion on PDE Fields

Probabilistic modeling of physical fields benefits from both a data-driven prior and known physical structure such as the governing equations. Energy-based models (EBMs) are a natural fit since energies compose additively, which enables augmenting physics information during inference. However, EBMs have been difficult to train and sample from due to the intractable partition function. We show in this work that flow matching models with a potential-induced velocity yield an explicit scalar energy at all transport times, whose gradient is exactly the converted learned score and which recovers the marginal negative log-density at the population optimum. The time-dependent energy functions are obtained purely from the matching regression objective on an independent linear Gaussian interpolation, without a variational form or additional MCMC steps, and the sampling retains the flow ODE. Access to the energy function from a trained model serves three roles: energy-corrected data generation, energy as a scoring function for out-of-distribution (OOD) detection, and energy compositional posterior sampling for inverse problems. In particular, we show the explicit energy permits general MCMC samplers in the predictor-corrector sampling framework, reducing PDE residual and spectral distance compared to the flow ODE baseline. Furthermore, we demonstrate utilizing the data energy and physics-based energy (e.g., PDE residuals) as complementary mechanisms to improve detection accuracy for OOD tasks. In addition, we explore the connection to MCMC-based inference for inverse problems by composing the energy with a quadratic observational likelihood that yields a posterior energy, used as an explicitly chosen family of inference-time targets.

AI advanced Machine Learning
By: Yixuan Sun, Anirban Samaddar, Sandeep Madireddy
Source: arXiv Aug 18, 2026
0.0
10 min read
0
Quality
📄 paper

TabNSM: Neural Sparse Mixer for Tabular Regression

Large-scale, high-dimensional tabular regression remains challenging: tree-based models are robust but lack end-to-end representation learning, while deep models enable flexible feature learning but often incur costly interaction modeling and sensitivity to noisy or redundant features. We propose TabNSM, a scalable regression framework that extends our earlier sparse-attention and mixer architectures. At its core, the Adaptive Sparse Interaction Module (ASIM) integrates foreground feature discovery, sparse local interaction encoding, and Feature-Token Mixing, providing near-linear complexity under fixed sparse configurations. For regression, TabNSM introduces three complementary components: a Multi-Stage Regression Head for progressive prediction refinement; GridLoss, an ordinal-aware soft-binning objective that incorporates target structure into representation learning; and RISE (Reweighted Instance Sampling by Error), a difficulty-aware sampling strategy based on loss-quantile bins. Across nine real-world regression benchmarks, TabNSM delivers strong predictive performance and practical scalability, with particularly consistent gains on high-dimensional and heterogeneous datasets. These results demonstrate that selective interaction modeling, structured regression supervision, and difficulty-aware sampling provide an effective and scalable approach to deep tabular regression.

AI advanced Machine Learning
By: Ali Eslamian, Qiang Cheng
Source: arXiv Aug 18, 2026
0.0
5 min read
0
Quality
📄 paper

Where A Small Language Model Helps in Invoice Categorisation, Understood Through Embedding Geometry

Categorising invoices into the correct General Ledger (GL) code underpins financial reporting and tax compliance. This is a skilled accounting judgement rather than a routine task: the correct category depends subtly on the nature of the purchasing business, the vendor and the invoice text. Whilst AI is increasingly being adopted across industries to automate tasks, including invoice categorisation, implementations built on in-house small language models (SLMs) can simultaneously reduce cost and improve data security, confidentiality, and interpretability. We investigate this approach by first analysing the pre-trained embedding geometry of a small sentence transformer (SBERT) and classic SLM (DeBERTa). The sentence-embedding space of this financial corpus is globally anisotropic but composed of locally isotropic clusters, extending prior token-level findings to sentence embeddings in a financial setting, and these clusters are strongly correlated with the vendor identity. SBERT fine-tuned on a single GPU reaches 0.96 accuracy on invoice classification, above both a zero-shot LLM and a vendor identity baseline, increasing performance for smaller, challenging categories and new clients. For this important generalisation problem, SBERT reaches 0.9 F1 with roughly 100 client-specific invoices, showing that an in-house SLM implementation is promising. Combining these results with geometric analysis shows that pre-trained embedding geometry is associated with classification performance and reveals a counterintuitive finding that a structured input that would help a human reader does not improve the SLM performance.

AI advanced Machine Learning
By: Emma Ceccherini, Daniel Lawson, Anjulika Salhan
Source: arXiv Aug 18, 2026
0.0
10 min read
0
Quality
📄 paper

TokEval: A Tokenizer Evaluation Suite

Language model tokenizers are typically selected with minimal evaluation, despite the fact that their design choices directly impact model capabilities. This can be partly attributed to a limited understanding of which tokenizer properties affect which aspects of downstream performance. We introduce TokEval, a framework of tokenizer evaluation metrics that goes beyond standard measures like fertility and compression rate to capture linguistically and structurally meaningful properties, e.g., UTF-8 character boundary integrity and digit place-value boundary alignment for mathematics. To validate whether these metrics are predictive of downstream model performance, we conduct controlled language model pretraining experiments, varying solely the tokenizers' training data mixture, pretokenization strategy, and training algorithm. We evaluate the resulting models on bits-per-byte (a tokenizer-agnostic version of perplexity) and several benchmarks, spanning linguistic understanding, mathematical reasoning, and code generation. Our experiments suggest that different intrinsic properties have different impacts on model abilities: information-theoretic metrics predict language modeling abilities (Spearman rho up to 0.80), while structure-sensitive metrics, such as those measuring digit and line-break handling, correlate with task accuracy. We hope TokEval enables more principled tokenizer evaluation, replacing pretraining sweeps with intrinsic measurement wherever the two agree.

AI advanced Natural Language ProcessingMachine Learning
By: Clara Meister
Source: arXiv Aug 18, 2026
0.0
5 min read
0
Quality
📝 blog

5 Tools for Building and Deploying AI Agents in Production

This article walks through five tools, one for each layer of the stack from building the agent's logic to running all of it at scale.

AI intermediate Data ScienceMachine Learning
By: Shittu Olumide
Source: KDnuggets Aug 19, 2026
0.0
1 min read
0
Quality
📝 blog

How to Answer AI System Design Interview Questions

The interview moved from Design YouTube to Design ChatGPT. Here's the framework.

AI intermediate Data ScienceMachine Learning
By: Nate Rosidi
Source: KDnuggets Aug 19, 2026
0.0
1 min read
0
Quality
📝 blog

When AI Engineers Disagree, Who Should You Trust?

The most useful AI answer isn’t always the one that sounds the most confident.Continue reading on Magic AI »

AI intermediate Artificial IntelligenceAI Industry
By: MADHU SREE SAREDDY
Source: Medium - AI Aug 19, 2026
0.0
1 min read
0
Quality
📝 blog

Spec-Driven Development: How I Stopped Vibe Coding My AI Agents

Three models paid to break the spec, before a single line of code gets written.Continue reading on Medium »

AI intermediate Artificial IntelligenceAI Industry
By: Giuseppe Trisciuoglio
Source: Medium - AI Aug 19, 2026
0.0
1 min read
0
Quality
📝 blog

AI Is About to Walk Off the Screen — and Almost Nobody Is Asking Who Builds Its Brain

For three years, artificial intelligence has lived inside a chat window.Continue reading on Medium »

AI intermediate Artificial IntelligenceAI Industry
By: Snipetr
Source: Medium - AI Aug 19, 2026
0.0
1 min read
0
Quality
📝 blog

Day 72: Large Language Models (LLMs) — The Technology Behind Modern Generative AI

Large Language Models, commonly known as LLMs, have transformed the way we interact with Artificial Intelligence.Continue reading on Medium »

AI intermediate Machine LearningAI Industry
By: Tarushi Sandeep Gupta
Source: Medium - Machine Learning Aug 19, 2026
0.0
1 min read
0
Quality
📝 blog

Polynomial Regression in Machine Learning: Teaching Linear Regression to Bend

Linear Regression is one of the first algorithms we usually learn in Machine Learning.Continue reading on Medium »

AI intermediate Machine LearningAI Industry
By: Priyanshu
Source: Medium - Machine Learning Aug 19, 2026
0.0
1 min read
0
Quality