The game engine is bounded to the same technical limitations of the Nintendo 64, even when running on a emulator. So if you hack exceed the N64 capabilities, it will not work.
You'll have to stick to the N64 specifications (supposing your hack is not only super graphics, in which case you could either make a texture pack instead or write a brand new engine) if you want you hack to work.