Remixing your art with AI

17810121322

Comments

  • generalgameplayinggeneralgameplaying Posts: 517
    edited January 2023

    SnowSultan said:

    Then go argue it in the other thread. Sheesh, "kill each other"? No less than war? The anti-AI crowd are the ones who don't understand how it works because they keep repeating the lie that it just reassembles pieces of stolen art.

     

    Thanks Griffin, I will check your PM shortly.

    Admittedly slightly leaning out of the window there, yet still:

    - "Pro ai folks" (which factually are??) tend to not argue at all, but praise the function they want. "We want / it / now". So arguments don't count much at all anyway? This appears to be "crowd work". 

    - I'm not anti-ai at all. I see issues, a) mid to long term, b) with the current HUMANS and their concepts, pushing their specific version of "the whole damn thing". 

    - Concerning "understanding war." ... will you "succeed" just by not mentioning it? Or is there an actual conflict (ahead)?

     

    But this is the joke. Once actual (side topic) discussion is done. Someone pops up with a lengthy post about how people are anti-ai, and that/why (though not actually explaining why) nothing can be done anyway, so why not just proceed as scheduled?

    (Concerning "the lie": While law-people aren't fully sure, the basic idea is not incorrect. It's encylopedic by nature, despite doing something more than just a direct collage of original images. During the training process, the system expressly recreates source images as accurate as possible, it's what the system is based on. It's not directly stealing, but together with the tagging as is, it's clearly a very big part of "the problem". In essence claiming lies, but not argueing, i see where from that is going. It shouldn't go anywhere, if you want to be part of a civiliazation.)

    Post edited by generalgameplaying on
  • SnowSultanSnowSultan Posts: 3,599

    I don't care if Frank or Richard removes my posts, I'm saying this anyway: because there is another gigantic AI thread where you can argue the legality of AI all you want. This one is supposed to be for REMIXING YOUR ART WITH AI, and I'm happy to try and help with that if I am able because I believe that AI should be used as a tool to help artists and it's not going away anyway.

  • SnowSultan said:

    I don't care if Frank or Richard removes my posts, I'm saying this anyway: because there is another gigantic AI thread where you can argue the legality of AI all you want. This one is supposed to be for REMIXING YOUR ART WITH AI, and I'm happy to try and help with that if I am able because I believe that AI should be used as a tool to help artists and it's not going away anyway.

    Haha, no question "ai" will not go away, at least in terms of the technique, and there will be tools for sure. Also agreed about the other thread. On the other hand, the people posting images here, keep arguing themselves same way :p, while the original poster (wisely so?) has vanished from it. So be it, remixing...

  • frank0314 said:

    When will it get to the point where it starts creating false situations amongst real people

    To an extent it is currently possible. However, the capabilities to identify forgery currently outstrip the ability to create them. 

    However "flash fakes" which cause a certain event or effect during a short period of time have been around since Photoshop / the last decade. In one instance, it actually caused a protest in Europe. People came to their senses eventually. 

  • FirstBastionFirstBastion Posts: 7,771

    Some AI generated art

     

    thekidsarealright.jpg
    210 x 211 - 23K
  • A final reminder to keep the discussion civil.

  • BandoriFanBandoriFan Posts: 364
    edited January 2023

    I got Corel Paintshop Pro in a Humble Bundle sale and used it to edit the originals which I included for reference. I'm doing a lot of prompts with different renders to see what I get. Slime was one of the prompts for all of these. I make these as references for drawing 

    27 1 2023 b 257.png
    1920 x 3136 - 6M
    27 1 2023 b 303.png
    1920 x 3136 - 5M
    29 1 2023 195.png
    1920 x 3136 - 5M
    29 1 2023 195.JPG
    960 x 1568 - 215K
    27 1 2023 b 257.JPG
    960 x 1568 - 248K
    27 1 2023 b 303.JPG
    960 x 1568 - 169K
    Post edited by BandoriFan on
  • WendyLuvsCatzWendyLuvsCatz Posts: 38,289

    I have done an even trippier Act2 of Nosferato devil

  • GoggerGogger Posts: 2,401

    WendyLuvsCatz said:

    Gogger said:

    WendyLuvsCatz said:

    another DAZ render given the ai treatment (was Bijou in Eowyn dress)

    I like this! Something about the old-tyme animation jumpiness, the arm movement, and of course the flowing fabric. Nice!

    well it is dforce

    (original on sides in video above ) 

    For some reason, I can just sit here watching her right hand (left of screen) and the way it moves the fingers. SO COOL!
  • I used an AI to generate seamless fabric tiles... it was an interesting and reasonably productive experiment.  Unfortunately, I don't think my browser plays well with the others.

  • ArtiniArtini Posts: 9,500

    Gogger said:

    WendyLuvsCatz said:

    Gogger said:

    WendyLuvsCatz said:

    another DAZ render given the ai treatment (was Bijou in Eowyn dress)

    I like this! Something about the old-tyme animation jumpiness, the arm movement, and of course the flowing fabric. Nice!

    well it is dforce

    (original on sides in video above ) 

    For some reason, I can just sit here watching her right hand (left of screen) and the way it moves the fingers. SO COOL!

    I agree, it is a mesmerising view.

     

  • IteraItera Posts: 5

    It's quite interesting to read this entire thread. Although I hadn't originally planned to post, here is my attempt at a workflow with DAZ and Stable Diffusion. 

    I used several of my own blender renders to train an embedding. Then I wanted to combine the embedding and a Genesis 8 custom character that I created,who resembles the embedding, essentially using Genesis 8 as an avatar. That way I can pose her, alter the lighting, change her clothing and hair, render in iray, and then use imgtoimg to add the cembeddeding. It could also mimic her facial expressions.

    Before I've used iray renderings plus imgtoimg without any embedding involved and with a low denoising value, but it was hit-and-miss. Even though I was using the same seed and prompt, changing the lighting, the clothing, or the camera angle would cause imgtoimg to change the face of my character. Additionally, the aspect ratio itself changed the face too. 

    Given that I'm using low denoising values and my G8 character already resembles the embedding (albeit not exactly, but real people look differently depending on the lighting), it ought to have worked.
    If I had the same seed each time, it should to have producted the same face. Okay, no! SD doesn't know that this is the same person (or that that it is a person at all). When I tried to increase the denoising value, it initially merely combined the two faces, but it eneded up with different combination for each picture,but and it also made some caricatures, blurry images and nightmare fuel. Also, if I adjust the lighting or aspect ratio, I would get a different person.

    I made several attempts to make it work. It was really hit-and-miss. I was able to make it work in the end and keep the lighting, pose, clothing and hair of the G8 while also producing a person who is reasonably consistent and somewhat resembles my character. The process as a whole was interesting and somewhat irritating. It is still far from ideal, but I like promise of what this could do someday.

    Even with lower denoising levels, SD managed to mess up the hands and other little things. 

    The embedding is not very consistent in and of itself. The images I've shared are the ones that are more reliable. Even when used in SD with just a prompt it will change the contour of her face, the color of her eyes, and the shape of her eyebrows. Sometimes it would dramatically age her or turn her into a caricature.
    I used to overlook all things in the beginning. Now looking back at it, I see plenty of nightmare fuel.

     

    embedding_1.png
    986 x 1044 - 1M
    iray_renders_1.png
    986 x 1044 - 997K
    some_fails.png
    986 x 1044 - 739K
    better_results.png
    986 x 1044 - 1M
  • WendyLuvsCatzWendyLuvsCatz Posts: 38,289
    edited February 2023

    Filament and AI

    sphinxA.jpg
    2429 x 4000 - 5M
    sbaizp_ff8326be35a4c0deae44de01d507e09c27ef033a.jpg
    1125 x 1866 - 458K
    Post edited by WendyLuvsCatz on
  • ArtiniArtini Posts: 9,500

    Nice one, Wendy.

     

  • Belatedly moved to Art Studio

  • Phloki3dPhloki3d Posts: 138

    I've been having fun playing with the potential of stable diffusion in my workflow. Here's a remix that isn't quite final but shows some great results - As usual the hands are borked but they're getting better and better with the likes of ControlNet and some manual inpainting and post-work. 

    As it stands, designing a concept in Daz and then letting AI add that extra photorealism and its own creativity is working well for me though

    main.png
    1080 x 1350 - 2M
    remix.png
    1000 x 1000 - 1M
  • WendyLuvsCatzWendyLuvsCatz Posts: 38,289
    edited February 2023

    original Filament render video 

    AI transformation 

     

    sphinxman0500.jpg
    1125 x 1867 - 557K
    Post edited by WendyLuvsCatz on
  • MinamMinam Posts: 55

    Can we even use Stable Diffusion?

    I think the EULA was updated? 
     

    • License Restrictions. The Content is provided solely for User's use as permitted herein and in conformity for its intended purpose. User does not have the right to provide the Content to others in any form or on any media except as set forth in this Agreement. The Content may be copied in whole or in part solely for User's use as permitted herein. Specifically, User may copy the Content onto the storage device of an unlimited number of computers owned or controlled by User. The Content is for use solely by User and not by any other individual or entity. All individuals or entities must obtain their license to use the Content. Notwithstanding anything to the contrary contained herein, the Content License expressly excludes the use, incorporation, or input of any Content, in whole or in part, in connection with i) any AI engine, program, or system (including, without limitation, Image.ai, Nightcafe, Artbreeder, chatGPT, Shutterstock, DALL-E 2, Deep Dream Generator, Hotpot ai, DeepAI) with capabilities or instructions to auto-generate materials that are derivative, imitative, or otherwise plagiaristic of the Content; and ii) any activity contrary to the intended use of the Content License, or otherwise to circumvent the terms, restrictions, or safeguards applicable to this Content License. For the purposes of this EULA, "AI" means any method of artificial intelligence such as deep learning, neural networks, or any other similar technologies intended to consume and analyze content for the intent of auto-generating new content.
  • csaacsaa Posts: 824
    edited February 2023

    Richard Haseltine said:

    A final reminder to keep the discussion civil.

    I do wish we keep two running discussion threads. One for opining, gushing and bashing -- the usual eye gouging and hitting below the belt not allowed.  Another for tutorials, breaking news and showcasing personal work using AI. Of the later, ghoulish experiments glomming one's visge on animals are welcome ... <sigh> grudgingly so. 

    Cheers!

     

    Post edited by csaa on
  • yeah, I prefer this thread be for remixing our art with AI and try to use it as such 


    AI video

    original D|S video

  • MinamMinam Posts: 55

    csaa said:

    Richard Haseltine said:

    A final reminder to keep the discussion civil.

    I do wish we keep two running discussion threads. One for opining, gushing and bashing -- the usual eye gouging and hitting below the belt not allowed.  Another for tutorials, breaking news and showcasing personal work using AI. Of the later, ghoulish experiments glomming one's visge on animals are welcome ... <sigh> grudgingly so. 

    Cheers!

    Hey, what's the other thread becuase I don't think some people at Daz3D want us to use AI to remix, have you seen changes to the EULA?  That's news worthy, right? 
    I noticed they don't have Stable Diffusion listed, is the term Remix a new thing and allowed? 
    At the same time, don't we own the copyrights for our renders, so we are okay to use our 2D renders as we wish, correct?

  • MinamMinam Posts: 55

    Itera said:

    It's quite interesting to read this entire thread. Although I hadn't originally planned to post, here is my attempt at a workflow with DAZ and Stable Diffusion. 

    I used several of my own blender renders to train an embedding. Then I wanted to combine the embedding and a Genesis 8 custom character that I created,who resembles the embedding, essentially using Genesis 8 as an avatar. That way I can pose her, alter the lighting, change her clothing and hair, render in iray, and then use imgtoimg to add the cembeddeding. It could also mimic her facial expressions.

    Before I've used iray renderings plus imgtoimg without any embedding involved and with a low denoising value, but it was hit-and-miss. Even though I was using the same seed and prompt, changing the lighting, the clothing, or the camera angle would cause imgtoimg to change the face of my character. Additionally, the aspect ratio itself changed the face too. 

    Given that I'm using low denoising values and my G8 character already resembles the embedding (albeit not exactly, but real people look differently depending on the lighting), it ought to have worked.
    If I had the same seed each time, it should to have producted the same face. Okay, no! SD doesn't know that this is the same person (or that that it is a person at all). When I tried to increase the denoising value, it initially merely combined the two faces, but it eneded up with different combination for each picture,but and it also made some caricatures, blurry images and nightmare fuel. Also, if I adjust the lighting or aspect ratio, I would get a different person.

    I made several attempts to make it work. It was really hit-and-miss. I was able to make it work in the end and keep the lighting, pose, clothing and hair of the G8 while also producing a person who is reasonably consistent and somewhat resembles my character. The process as a whole was interesting and somewhat irritating. It is still far from ideal, but I like promise of what this could do someday.

    Even with lower denoising levels, SD managed to mess up the hands and other little things. 

    The embedding is not very consistent in and of itself. The images I've shared are the ones that are more reliable. Even when used in SD with just a prompt it will change the contour of her face, the color of her eyes, and the shape of her eyebrows. Sometimes it would dramatically age her or turn her into a caricature.
    I used to overlook all things in the beginning. Now looking back at it, I see plenty of nightmare fuel.

    @Itera , have your tried the LoRa Model with control dot net? It should provide you with the results you are looking for. 
    However, I don't know if the workflow is allowed given changes to the EULA.  
    I'm buying a Blender model after contacting the artist and asking if they were okay if I trained LoRa Models with images generated from their 3D model. 

  • BandoriFanBandoriFan Posts: 364
    edited March 2023

    I upsampled and corrected them in a photo editing software. I make them as references to drawover and so many things like faces, fingers, and proportions can be so wrong. Painting can be pretty hard especially if it's a detailed reference 

    19 2 2023 1276.png
    1920 x 3136 - 6M
    30 1 2023 378.png
    1920 x 3136 - 6M
    Post edited by BandoriFan on
  • EthinEthin Posts: 1,138
    edited March 2023

    I don't know if this counts as remixed or post-worked. I think I spent 2-3 times as much time on the AI\Photoshop part as I did on the original D|S render.

     

    Original

     

    Post-worked

    Terra 2021 test 02 libit2.jpg
    960 x 1280 - 809K
    Terra 2021 test 02 AI post3b.jpg
    960 x 1280 - 658K
    Terra 2021 test 02 AI post3.jpg
    960 x 1280 - 667K
    Post edited by Ethin on
  • Rafael_4557471Rafael_4557471 Posts: 136
    edited March 2023

    Here is my experiment.

    I did not use the AI to modify the final render, but only to generate an interesting background. What I did a lot was test different scenarios where I could put one Daz figure, especially with a good side light.

    Then, I put a base pose and rotation. It was tricky to adjust the camera to give the illusion of size and position.

    A lot of testing of lights as main illumination and the fake lights to make specific shadows on dummy planes. And some shadows drawn by hand. It is not perfect, but for now, will do.

    The original image.

     

    Post edited by Rafael_4557471 on
  • EthinEthin Posts: 1,138
    edited March 2023

    I got a different model that I thought would complement the style of my renders more and was trying it out on the same render from my last post. You know how the AI does some crazy stuff to your image if you give it to much freedom?

    About the only thing left from the original image is the lighting angle. I know I wouldn't be able to get it to generate something like this on purpose. A random outlier that only existed for one step. Fleeting beauty, there for only a moment then gone forever.

    Terra 2021 test 02 AI TooMuch.jpg
    960 x 1280 - 390K
    Post edited by Ethin on
  • WendyLuvsCatzWendyLuvsCatz Posts: 38,289

    a video by me, sort of

    I used other people's 3D models as well as AI and music

    But

    DAMNIT I am A Producer!

  • wsterdanwsterdan Posts: 2,351

    WendyLuvsCatz said:

    a video by me, sort of

    I used other people's 3D models as well as AI and music

    But

    DAMNIT I am A Producer!

    Damn right you are!

    Another interesting production, thanks for sharing.

    I should have said it long before now, but I have to say that I find you very inspiring. Beyond the massive volume of work you've produced over the years, what I find most inspiring is the incredible range of software and methods you employ, from "simple" Cararra to the latest AI experiments, you never, ever stand still. I can honestly say I never know what you're going to try next, only that you will be trying something new as soon as something new is available.

    Much appreciated. 

    -- Walt Sterdan

  • WendyLuvsCatzWendyLuvsCatz Posts: 38,289

    thankyouheart

Sign In or Register to comment.