Well, I did it... a ray tracer in JavaScript. The code is pretty close to a direct translation of the raytracer I did for my computer graphics class, which you can find here (code under "handed_in/"). It's not really complete (spheres only, no reflections), and has some bugs.
Progress: