gnn-audio-generation

name: gnn-audio-generation description: GNN audio generation and sonification. Use when creating audio representations of GNN models, generating sonification of state spaces, or working with SAPF and Pedalboard audio backends.

GNN Audio Generation (Step 15)

Purpose

Generates audio representations (sonification) of GNN models, mapping model structures, state transitions, and matrix values to sound parameters using SAPF, Pedalboard, and other audio backends.

Key Commands

# Run audio generation
python src/15_audio.py --target-dir input/gnn_files --output-dir output --verbose

# As part of pipeline
python src/main.py --only-steps 15 --verbose

API

from audio import (
    AudioGenerator, process_audio, generate_audio_from_gnn,
    create_sonification, analyze_audio_characteristics,
    SAPFGNNProcessor, SyntheticAudioGenerator,
    check_audio_backends, generate_oscillator_audio,
    apply_envelope, mix_audio_channels,
    convert_gnn_to_sapf, generate_audio_from_sapf
)

# Process audio step (used by pipeline)
process_audio(target_dir, output_dir, verbose=True)

# Generate audio from GNN model
result = generate_audio_from_gnn(gnn_content, output_dir="output/")

# Create sonification
audio_data = create_sonification(model_data)

# Use AudioGenerator class
gen = AudioGenerator()

# Convert GNN to SAPF format and generate audio
sapf_code = convert_gnn_to_sapf(gnn_content)
generate_audio_from_sapf(sapf_code, output_path="model.wav")

# Check available backends
backends = check_audio_backends()
# Returns: {'librosa': {'available': True}, 'soundfile': {...}, 'pedalboard': {...}}

Key Exports

• AudioGenerator / SAPFGNNProcessor — audio generator classes
• process_audio / generate_audio_from_gnn — main generation functions
• create_sonification — sonification from model data
• SyntheticAudioGenerator — procedural audio generation
• generate_oscillator_audio, apply_envelope, mix_audio_channels — low-level audio
• check_audio_backends — check librosa/soundfile/pedalboard availability

Dependencies

# Audio generation deps
uv sync --extra audio

# Includes: librosa, soundfile, pedalboard, pydub

Output

• Audio files (WAV) in output/15_audio_output/
• Sonification parameter maps
• Audio generation reports

MCP Tools

This module registers tools with the GNN MCP server (see mcp.py):

• analyze_audio_characteristics
• check_audio_backends
• get_audio_generation_options
• get_audio_module_info
• process_audio
• validate_audio_content

References

• AGENTS.md — Module documentation
• README.md — Usage guide
• SPEC.md — Module specification
• sapf/ — SAPF framework

Documentation

• README: Module Overview
• AGENTS: Agentic Workflows
• SPEC: Architectural Specification
• SKILL: Capability API