Wang Yau Li

Portrait of Wang Yau Li

Applied AI / Speech LLM Engineer | ASR/TTS Evaluation, LLM-as-Judge, Speech Agents

GitHub | LinkedIn

Notes

Inception into J-Space

A layer-by-layer descent from readable words to nonliteral acoustic representations—and experiments asking whether the right anchor, placed at the right layer and time, can steer what emerges.

Read the full note →

Evaluation, memory, and agent loops

Notes on evaluation speed, portable memory, shared skills, interaction latency, automation harnesses, capital, infrastructure, and talent pools.

  1. Fast, valid evaluation is the outer-loop gradient descent of AI systems: the quicker we measure behavior, the quicker the system improves.
  2. A model instance is only the executor; continuity comes from shared memory. Different hosts can feel like one agent if they inherit the same history, constraints, and feedback loop.
  3. Shared skills are a knowledge layer, not a model layer: they let different models reuse useful behaviors without retraining.
  4. Interaction speed shapes adoption. The easier and faster a tool feels, the wider its influence can spread.
  5. Audio agents make evaluation perceptual: timing, hesitation, interruption, tone, and repair expose quality before the transcript does.
  6. Automation lowers the cost of intention by turning a goal into an environment: scenario, loop, constraints, and score. Harnesses are gradient descent at workflow scale.
  7. Capital > infrastructure > talent pool: in order of impact.
  8. Big tech is closer to the surface representation of problems under the hood; proximity gives signal, not necessarily solutions.

Beings as cumulative projections

A note cluster on experience, environmental shaping, technology as information transfer, and the unknowable scale of reality.

  1. We are the projection of our experience, both mental and physical.
  2. To understand an animal or plant is to grasp its neural connections, shaped by environmental influences over time, even before the existence of that specific being. This applies to humans as well. It's a continuous process along the time dimension, where a being is essentially a projection of cumulative experiences.
  3. Technological progression can be measured by the speed at which information is conveyed, transformed, or transferred between individuals, including the cost and time required to train or equip individuals to comprehend technological concepts.
  4. "As humans we experience only a tiny slice of the full scale of reality."
  5. "We're never gonna know the impact of discovering any single building block of reality."

Compression, perspective, and information density

Early notes on language as world compression, model weights as language, and meaning as a non-linear structure.

  1. Language is a condensed representation of the world.
  2. Weights in language models are their own form of language.
  3. Training a model is designing a language capable of efficiently capturing important aspects of the world.
  4. Prediction is compression. And, high velocity of information communication (between neurons, models, beings, organizations) fosters intelligence.
  5. Language evolution is driven by its users (not necessarily human); the importance of aspects is always a design choice, even if made unconsciously.
  6. Life is a search for the neural connections that best intersect our personal experiences with internal world representations.
  7. Inherent truths and information are contained within efficient structures, both tangible and intangible.
  8. All representations are simplified projections of a perfect form, differing in perspective.
  9. Human languages are a compromised form tailored to our biological capacity for interpersonal communication.
  10. Follow the eyes of other beings; they reveal perspectives you might have missed.
  11. Meaning is not inherently linear, though its surface form may appear to be.
  12. The beauty of art lies in its information density.