Re: control that floating point [was: Re: single precision]

[Thatcher Ulrich <tu@...>]

On Mar 09, 2004 at 07:45 +0800, Brett Bibby wrote:
> 
> We are also using 24 bit precision because of DX and I converted Lua
> to use floats. It seems that it's actually Lua that is trashing the
> FPU in certain cases from the VM. Perhaps there is some casting
> to/from float between script tokens or something that is causing
> this?  I don't have the time to track it down atm, but I will try to
> find the exact cause, meanwhile wrapping the calls into and out of
> Lua fixes the problem (which is the FPU nan bit gets set when a read
> occurs on an uninited register).

A good debugging tool in this situation is to turn on FPU exceptions,
and run in the debugger.  It should break on the line that does an
invalid op.  Assuming that's what's going on.  Might help you, might
not, but when it helps it really helps.

-- 
Thatcher Ulrich
http://tulrich.com