Mac gpu acceleration crashes and workaround

I'm not sure if this is a bug in Studio or in the Nvidia webdrivers, but certain shaders crash Mac hardware acceleration--including shaders distributed recently by Raiya and Stonemason (e.g., Cailin and Fern Lake). This bug apparently affects Macs running unflashed cards (I have one mac with an unflashed 970 and another with an unflashed Titan X, and it affects both machines). I don't know if it affects Macs running Apple's native drivers (but I'd like to find out--someone please test and confirm). 

Here's the problem: Load an affected product (e.g., Cailin HD), render, and hardware acceleration crashes. Studio continues to render in CPU (i.e., very slowly). The log indicates the following: 

2016-05-30 18:05:19.819 WARNING: /src/pluginsource/DzIrayRender/dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.3   IRAY   rend error: Kernel [0] failed after 0.000s2016-05-30 18:05:19.819 WARNING: /src/pluginsource/DzIrayRender/dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.3   IRAY   rend error: CUDA device 0 (GeForce GTX TITAN X): an illegal instruction was encountered (while launching CUDA renderer in core_renderer_wf.cpp:821)2016-05-30 18:05:19.819 WARNING: /src/pluginsource/DzIrayRender/dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.3   IRAY   rend error: CUDA device 0 (GeForce GTX TITAN X): Failed to launch renderer2016-05-30 18:05:19.819 WARNING: /src/pluginsource/DzIrayRender/dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.2   IRAY   rend error: CUDA device 0 (GeForce GTX TITAN X): an illegal instruction was encountered (while de-allocating memory)2016-05-30 18:05:19.819 WARNING: /src/pluginsource/DzIrayRender/dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.2   IRAY   rend error: CUDA device 0 (GeForce GTX TITAN X): an illegal instruction was encountered (while de-allocating memory)2016-05-30 18:05:19.819 WARNING: /src/pluginsource/DzIrayRender/dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.2   IRAY   rend error: CUDA device 0 (GeForce GTX TITAN X): an illegal instruction was encountered (while de-allocating memory)2016-05-30 18:05:19.819 WARNING: /src/pluginsource/DzIrayRender/dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.2   IRAY   rend error: CUDA device 0 (GeForce GTX TITAN X): an illegal instruction was encountered (while de-allocating memory)2016-05-30 18:05:19.819 WARNING: /src/pluginsource/DzIrayRender/dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.2   IRAY   rend error: CUDA device 0 (GeForce GTX TITAN X): an illegal instruction was encountered (while de-allocating memory)2016-05-30 18:05:19.819 WARNING: /src/pluginsource/DzIrayRender/dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.2   IRAY   rend error: CUDA device 0 (GeForce GTX TITAN X): Device failed while rendering2016-05-30 18:05:19.819 WARNING: /src/pluginsource/DzIrayRender/dzneuraymgr.cpp(261): Iray WARNING - module:category(IRAY:RENDER):   1.2   IRAY   rend warn : Re-rendering iteration because of device failure2016-05-30 18:05:19.819 WARNING: /src/pluginsource/DzIrayRender/dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.2   IRAY   rend error: All workers failed: aborting render2016-05-30 18:05:19.820 WARNING: /src/pluginsource/DzIrayRender/dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.2   IRAY   rend error: CUDA device 0 (GeForce GTX TITAN X): an illegal instruction was encountered (while de-allocating memory)2016-05-30 18:05:19.820 WARNING: /src/pluginsource/DzIrayRender/dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.2   IRAY   rend error: CUDA device 0 (GeForce GTX TITAN X): an illegal instruction was encountered (while de-allocating memory)2016-05-30 18:05:19.820 WARNING: /src/pluginsource/DzIrayRender/dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.2   IRAY   rend error: CUDA device 0 (GeForce GTX TITAN X): an illegal instruction was encountered (while de-allocating memory)2016-05-30 18:05:19.820 WARNING: /src/pluginsource/DzIrayRender/dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.2   IRAY   rend error: CUDA device 0 (GeForce GTX TITAN X): an illegal instruction was encountered (while de-allocating memory)2016-05-30 18:05:19.820 WARNING: /src/pluginsource/DzIrayRender/dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.2   IRAY   rend error: CUDA device 0 (GeForce GTX TITAN X): an illegal instruction was encountered (while de-allocating memory)2016-05-30 18:05:19.820 WARNING: /src/pluginsource/DzIrayRender/dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.2   IRAY   rend error: CUDA device 0 (GeForce GTX TITAN X): an illegal instruction was encountered (while de-allocating memory)2016-05-30 18:05:19.820 WARNING: /src/pluginsource/DzIrayRender/dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.2   IRAY   rend error: CUDA device 0 (GeForce GTX TITAN X): an illegal instruction was encountered (while de-allocating memory)2016-05-30 18:05:19.820 WARNING: /src/pluginsource/DzIrayRender/dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.2   IRAY   rend error: CUDA device 0 (GeForce GTX TITAN X): an illegal instruction was encountered (while de-allocating memory)2016-05-30 18:05:19.820 WARNING: /src/pluginsource/DzIrayRender/dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER):   1.2   IRAY   rend error: CUDA device 0 (GeForce GTX TITAN X): an illegal instruction was encountered (while de-allocating memory)2016-05-30 18:05:19.820 WARNING: /src/pluginsource/DzIrayRender/dzneuraymgr.cpp(261): Iray WARNING - module:category(IRAY:RENDER):   1.2   IRAY   rend warn : All available GPUs failed.2016-05-30 18:05:19.820 Iray INFO - module:category(IRAY:RENDER):   1.2   IRAY   rend info : Falling back to CPU rendering.

 

After much testing and retesting, I have narrowed the problem to the existence of texture files in certain shader channels. In particular, any texture in the following channels will crash hardware acceleration: 

Transmitted Color (SSS), translucency weight, glossy roughness, and textures on the roughness channels of Stonemason's Fern Lake all crash hardware acceleration. 

The workaround is simple: remove these textures (i.e., click on each and selct "none"). When this is done, the products render with full gpu acceleration. This is a tolerable workaround, since there is very little perceivable difference between renders with and without these textures (at least to my eyes in my tests--YMMV). 

Still, it would be better and less of a hassle to get it properly fixed, which means first nailing down whether this is a Mac drivers issue or a Studio for Mac issue. I have confirmed these shaders work fine out of the box on Windows. 

Running unflashed cards in a Mac is officially unsupported (but very widespread), so if it turns out these products work correctly using native Apple hardware, it may be hard to get anyone to fix the bug (either DAZ or Nvidia). If anyone is using DAZ on native Mac hardware with native Apple drivers, could you confirm whether this bug afflicts your setup too? You don't need any of the affected products to test; just put a texture in any of the indicated channels on whatever you have, and see if harware acceleration crashes. For example, I have confirmed the V7 will crash acceleration if I put her SSS texture (or any texture) in the transluceny weight channel of any surface. If the same it true on supported systems, we can figure out who to ask about squashing this bug. 

Of course, if there's a known bug causing this, I'd like to hear about that too! Thanks for any info anyone might have. 

 

Comments

  • nickalamannickalaman Posts: 196

    Can you try with optix prime acceleration turned off and see if that solves the issue. I used to have tons of crashes with optix acceleration, they stopped when i turned it off. By the way had the same problem as your self with calin, but she worked fine with optix off.

     

    Let me know.

     

     

  • recharredrecharred Posts: 16

    I never run with optix on. I tried it a bit awhile ago and didn't see any advantage. I checked in case it was left checked, but it's not. 

    Are you running a mac? What drivers and card? 

  • nickalamannickalaman Posts: 196

    Yes, latest version of OSX and also latest version of webdrivers and cuda drivers, there was a cuda update about 2 weeks ago. 7.5.30

    The card is 980ti

     

  • recharredrecharred Posts: 16

    Interesting. Can you confirm whether or not gpu acceleration works OK on your system with a texture loaded in the above mentioned channels? (Transmitted Color (SSS), translucency weight, glossy roughness) 

    Also, are you driving the monitor off the 980ti, or do you have a separate card for video? 

     

  • nickalamannickalaman Posts: 196

    Monitor is driven by 980ti, also tested on 780 and Titan Black, still no problem... I looked at the materials, and yes there was a material in Transmitted Color (SSS), the other 2 had values, but i plugged a material in there anyway and still no problem...

    try setting render setting to default and try again, because now it sound like there something wrong with you setup or software.

     

  • recharredrecharred Posts: 16

    That's weird, cuz I've got two different systems with the same reproducible problem, one of which is a recent clean install. I wonder if I have some or another plugin causing a problem. I'm gonna look close to see what's up, maybe do another clean install in a new partition with no plugs and a stripped down content folder and see if that's anything. I won't get to this for awhile, but I'll post back if I find anything. 

     

     

     

     

  • I'm seeing the same thing -- unable to render on the GPU on OS X 10.11.5 if there is an image map in the Transmitted Color (SSS) slot. Reproduces both with Calin and with Brooklyn's eyes. The key error appears to be:

    WARNING: /src/pluginsource/DzIrayRender/dzneuraymgr.cpp(261): Iray ERROR - module:category(IRAY:RENDER): 1.3 IRAY rend error: CUDA device 0 (GeForce GTX TITAN X): an illegal instruction was encountered (while launching CUDA renderer in core_renderer_wf.cpp:821)
  • recharredrecharred Posts: 16

    OK, so I finally got back to this (been away on vacation). I just tested a clean install, and I don't see how there could be an issue with my setup. Here's what I did: Clean install of 10.11.5 (wipe the hard drive clean) on my mac pro 3,1 with a 970 card. Install latest nvidia web drivers and cuda. Download DIM and install just the default Studio install (all and only what the DIM installer automatically installs for a new install). Open Studio and load genesis 3. Select surfaces and change them to iRay uber base. Render. All is fine (GPU accelerated render). Next, insert a texture in the glossy roughness channel. Render. Acceleration does not work; log reports errors quoted above. 

    Nikalaman, are you sure you have acceleration working on Cailin and such? To be clear, the problem isn't a crash of Studio. Cailin and the rest render fine for me on the CPU. But the GPU acceleration exits with an error logged if there is any texture in the aforementioned channels. I'm just not seeing how this could be something on my setup, given the test above--everything bone stock from a clean install. If anything, maybe you have something different from a stock setup that's making it work (if it is). If that's the case, I'd love to figure out what that is :-)

    Anyway, I'm still hoping to hear if there is anyone rendering in iRay with Apple's native drivers. Does anyone do that? If it works on the supported systems, then there's little chance to get this fixed, but if it does not work on the officially supported systems, then we would have standing to file a bug report. I'm not sure anyone actually uses the Apple drivers for 3d stuff, however. Anyone? 

     

     

     

Sign In or Register to comment.