this post was submitted on 21 Oct 2023
37 points (80.3% liked)

Games

16734 readers
490 users here now

Video game news oriented community. No NanoUFO is not a bot :)

Posts.

  1. News oriented content (general reviews, previews or retrospectives allowed).
  2. Broad discussion posts (preferably not only about a specific game).
  3. No humor/memes etc..
  4. No affiliate links
  5. No advertising.
  6. No clickbait, editorialized, sensational titles. State the game in question in the title. No all caps.
  7. No self promotion.
  8. No duplicate posts, newer post will be deleted unless there is more discussion in one of the posts.
  9. No politics.

Comments.

  1. No personal attacks.
  2. Obey instance rules.
  3. No low effort comments(one or two words, emoji etc..)
  4. Please use spoiler tags for spoilers.

My goal is just to have a community where people can go and see what new game news is out for the day and comment on it.

Other communities:

Beehaw.org gaming

Lemmy.ml gaming

lemmy.ca pcgaming

founded 1 year ago
MODERATORS
nanoUFO@sh.itjust.works
37
Genshin Impact's new web event uses nightmare-inducing AI animation (www.destructoid.com)
submitted 1 year ago by stopthatgirl7@kbin.social to c/games@sh.itjust.works
19 comments fedilink hide all child comments
 

A new Genshin Impact web event has some great loot, but you're going to have to look at some terrifying AI animation.

you are viewing a single comment's thread
view the rest of the comments
[–] p03locke@lemmy.dbzer0.com 1 points 1 year ago (1 children)

Like, I like Lawrence of Arabia. That movie actually has pretty good-quality footage. But…there’s still film grain. And the frame rate is only so high. But there is a whole lot of footage of Lawrence in that movie, enough information to do a pretty good job, if used effectively, of dropping film grain, generating intermediate frames, and increasing the resolution.

This is possible today, and without much effort. Most Stable Diffusion kits just come with upscalers and, as long as you pick the right ones for the job, the models act like fucking magic. Way way better than any of the "nearest neighbor" algorithms image editors provide.

Video editors already have really good tools for interpolating frames for slow motion. They are a bit fiddly in high motion situations, but work well otherwise.

[–] tal@lemmy.today 1 points 1 year ago* (last edited 1 year ago) (1 children)

You can do upscaling with AI upscalers in SD today, yeah, and it's pretty nifty, but it's working with a 2D model. That's nice if you have a lot of footage of Lawrence from exactly the same angle; if you train a model on the whole video, then you can use that for upscaling individual frames.

But my point is that if you have software that's smart enough to make use of information derived with a 3D model, then you don't need to have that identical angle to make use of the information there.

Let's say that you've got a shot of Peter O'Toole like this:

https://prod-images.tcm.com/Master-Profile-Images/lawrenceofarabia1962.4455.jpg?w=824

And another like this:

https://media.vanityfair.com/photos/52d691da6088e6966a000006/master/w_2240,c_limit/1389793754760_lawrencethumb.jpg

Those aren't from the same angle.

But add a 3d model to the thing, and you can use data from the close-up in the first image to scale up the second. The software can rotate the data in three dimensions, understand the relationships. If you can take time into account, you could even learn how his robe flaps in the wind or whatnot.

One would need something like this.

[–] p03locke@lemmy.dbzer0.com 1 points 1 year ago

My point is that if all you are doing is cleaning up frames and trying to upscale footage from 24fps to 60fps, you have all of the data you need from the previous/next frames to blend those into in-between frames. A model trained on the movie would help, but there's no need to get into anything as complex as 3D models of objects. Sub-second animation data is just fine.