Realistic AR Hair Filters
Hi, I'm wondering how viable it would be to create ultra realistic hair filters and if this is like humanly possibly to create to a good degree of realisticness, how would I go about starting this project?
12 Replies
Also I'm not sure if C# is the best way forwards, but google told me it was. Still, I'm open to any suggestions and would greatly appreciate any input!
there is a lot of detail you need to provide before anyone can get near answering your question
what's a hair filter? what needs to be ultra realistic? is this for a game, photo editing, something entirely different?
By a hair filter I mean like a camera filter that overlays hair over your existing hair for the purpose of trying on hairstyles
And by ultra realistic I mean that it is possible for you to believe that the hair could possibly be real when looking at it on your screen, so that it gives a more accurate representation of what it would actually look like if you had that hairstyle
And this would be for an app where you can try on hairstyles
I feel like you'd want Python for part of your stack if you were doing this
if not the entire thing
JS for video streaming and python for the filters
sounds like a problem where ai could offset some of the math/simulation/generating costs.
How would I implement ai though? And wouldn't the quality suffer quite significantly
Not necessarily. I'm imagining a possible solution could go like this:
1. determine hairstyle stereotype & color
2. fetch prebuilt 3d model for that hairstyle
3. apply 3d model to video feed
4. ask for user feedback (textual/voice)
5. send model/ representation of model to ai endpoint with feedback + prompt etc.
6. loop from 3.
Hair can be generated quite realistically these days. If you can find a simple representation of the hair that is amenable to ai modification, I think this is quite doable without having to create a mathematical or even properly simulated 3d model.
AI support in net9 is quite nice; if you want to stay in dotnet land. I cannot comment on other stacks but I imagine python will have some nice libraries for this usecase.
dotnet land?
c#
Would creating the assets in blender, integrating ARKit into a program like Unreal Engine or Unity and then just mapping the model to the tracked hair be a good project pipeline?
I'm coming at this from a very beginners perspective with not too much coding knowledge (a little python from school) and right now I'm teaching myself blender
I have close to zero experience with 3d modeling, AR, game engines etc. so I can't comment on the idea. maybe someone more knowledgeable can chime in :)
Ah okay, thank you for your input thouh