THE INTERNET IS THINKING
Earlier sources: Multimodal AI systems
Multimodal AI systems process or generate more than one kind of information, such as text, images, audio, and video. Follow model architectures, cross-modal reasoning, interfaces, and evaluation.
SYMTRI organizes observations from public sources into a living map. Connections reflect shared subject matter; they do not establish causation or endorse a source.
Open in the map ↗39 classified signals in the fourteen-day window. These counts include signals awaiting readable evidence.
Earlier sources
Up to ten sources with readable evidence, ordered by their feed timestamp. These archive sources can be older than the live fourteen-day window. This list is a sample, not a measure of total activity. Dates distinguish paper publication, repository creation, model/dataset activity, Hacker News posts, and KEV catalog additions. “First archived” records when SYMTRI first stored the signal.
- arXiv · Published · First archived
VLALight: A Vision-Language-Action Model for Traffic Signal Control ↗
Traffic signal control (TSC) is essential for improving urban mobility and reducing congestion. Although roadside cameras are widely deployed at signalized intersections and provide rich visual observations of evolving traffic, existing TSC methods typically rely on manually engineered traffic states or separate perception modules, creating a gap between physical observations and control decisions. We present VLALight, the first vision-language-action (VLA) model for end-to-end traffic signal control from multi-view roadside videos. VLALight directly maps visual observations to coordinated sig…
- arXiv · Published · First archived
AeroManip-VLA: Scalable Vision-Language-Action Learning for Aerial Manipulation with RL-Generated Demonstrations ↗
Aerial manipulators extend robotic manipulation into 3D workspaces that are difficult for ground-based robots to access, creating new opportunities for general-purpose manipulation. However, extending Vision-Language-Action (VLA) models to aerial robots introduces distinct challenges due to the tight coupling between manipulation and flight, continuously changing observations, and safety-critical physical interactions. These challenges demand diverse training data and systematic policy evaluation, yet collecting demonstrations and evaluating policies directly on physical aerial platforms are c…
- arXiv · Published · First archived
RAEGNet: Relation-Aware Evidence Graph Network for Harm-Aware Multimodal Fake News Detection ↗
Existing multimodal fake news detection methods often introduce external information to assist detection. However, most of them rely on entity-level retrieval and are therefore prone to introducing event-irrelevant noise. Meanwhile, existing methods mainly focus on improving overall performance and do not account for differences in the degree of harm posed by different instances of fake news. To address these limitations, we design an Event-Level Evidence Retrieval Framework (ELERF) and propose a Relation-Aware Evidence Graph Network (RAEGNet). ELERF retrieves external evidence based on the co…
- GitHub · Repository created · First archived
Alpha-Park/genpark-meta-muse-multimodal-episodic-resonance-mcp ↗
Multimodal sensory grounding (Meta Ray-Ban audio/vision) integrated with long-term episodic life memory graphs and empathetic emotional resonance (Muse).
- GitHub · Repository created · First archived
alphaparkinc/genpark-meta-muse-multimodal-episodic-resonance-mcp ↗
Multimodal sensory grounding (Meta Ray-Ban audio/vision) integrated with long-term episodic life memory graphs and empathetic emotional resonance (Muse).
- GitHub · Repository created · First archived
Alpha-Park/genpark-agent-multimodal-document-table-extractor-skill ↗
Heuristic multi-column document and tabular markdown extractor converting ASCII/OCR text dumps, aligned spacing, and CSV/TSV into clean GitHub Flavored Markdown and typed JSON.
- GitHub · Repository created · First archived
alphaparkinc/genpark-agent-multimodal-document-table-extractor-skill ↗
Heuristic multi-column document and tabular markdown extractor converting ASCII/OCR text dumps, aligned spacing, and CSV/TSV into clean GitHub Flavored Markdown and typed JSON.
- OpenAlex · Published · First archived
Knowledge-grounded multimodal cognitive decision-making for aerospace machining: A physics-aware reasoning framework for generative process planning of special-shaped features ↗
Complex aerospace products encompass numerous special-shaped features (SSFs), whose machining processes rely on highly customized process planning. Traditional data-driven discriminative models predominantly operate as physics-agnostic "black boxes." Moreover, applying general-purpose Multimodal Large Language Models (MLLMs) to manufacturing often causes "physical hallucinations", generating linguistically plausible but mechanically infeasible process plans. To bridge this gap, this paper proposes a Knowledge-Grounded Multimodal Cognitive Framework (KGMCF), which extends discriminative feature…
- arXiv · Published · First archived
FlowAct-R2: Beyond Talking Avatar via Streaming Multimodal References and Proactive Agent Planning ↗
We present FlowAct-R2, a framework for interactive humanoid video generation that combines continuous multimodal control with proactive agent planning. Our method consists of two coupled components. First, a Streaming Multimodal Reference Diffusion Transformer adapts the pretrained Seedance 2.0 Mini reference-to-video backbone to accept rolling action prompts, streaming audio, and dynamically updated image, audio, and video references. Video-driven rotary positional embeddings align reference chunks with the generation timeline, while reference-plus-image conditioning and partially noised hist…
- Hacker News · Posted on Hacker News · First archived
A Vision-Language Model as a Teacher for Bird Vocalization Detection ↗
Hacker News discussion.
Live window recorded . This is the ingestion observation time, not the publication or discovery date of each source.
How to assess evidence about Multimodal AI systems
Check each original source for its methods, release status, limitations, and supporting data. A repository announcement, a preprint, and a published study provide different kinds of evidence. SYMTRI’s subject classification helps discovery; it does not independently validate the source’s claims.
See the collection and counting methodology ↗ · Read the weekly synthesis ↗
Related threads
Explore related regions
These navigation suggestions are part of the map’s editorial structure, rather than measured evidence of a connection.