Neural network image upscaling

Discussion forum for Celestia developers; topics may only be started by members of the developers group, but anyone can post replies.
Topic author
john71
Posts: 694
Joined: 10.08.2016
With us: 4 years 9 months

Neural network image upscaling

Post #1by john71 » 29.10.2020, 11:12

Hi! Neural image upscaling could help us make HD textures from low resolution ones. I found the projects neural-enhance and waifu2x which are developing open source tools. Do you know any other open source or offline neural upscaling projects?

Avatar
Goofy
Posts: 265
Joined: 30.08.2011
With us: 9 years 8 months
Location: Italy

Post #2by Goofy » 29.10.2020, 13:50

Hi John. :hi:
I searched and found many pages where it is possible to make a neural-enhance test, so I tried the "classic" 2k Phobos Celestia image, obtaining for free a 4k image, in a metter of seconds (a payment isdue for images bigger than 3000x3000 pixel , alas!).
Then I enlarged and cropped both images, and here we can see that, effectively, the image looks less noisy, smal craters are no more "square blobs", and the overall appearance is better, IMHO.
Comments?
Goofy :smile:
Attachments
New vs old-detail-comparison.JPG
"Something is always better than nothing!"
HP Omen 15-DC1040nl- Intel® Core i7 9750H, 2.6/4.5 GHz- 1TB PCIe NVMe M.2 SSD+ 1TB SATA 6 SSD- 32GB SDRAM DDR4 2666 MHz- Nvidia GeForce GTX 1660 Ti 6 GB

Avatar
Art Blos M
Moderator
Posts: 917
Joined: 31.08.2017
Age: 28
With us: 3 years 8 months
Location: Volgodonsk, Rostov Oblast, Russia

Post #3by Art Blos » 29.10.2020, 13:56

Goofy wrote:I searched and found many pages where it is possible to make a neural-enhance test, so I tried the "classic" 2k Phobos Celestia image, obtaining for free a 4k image, in a metter of seconds (a payment isdue for images bigger than 3000x3000 pixel , alas!).
Then I enlarged and cropped both images, and here we can see that, effectively, the image looks less noisy, smal craters are no more "square blobs", and the overall appearance is better, IMHO.
Comments?
IMHO, the difference is not significant. Any graphics editor can perform similar processing.
Founder and head of the project "Celestia Origin"

Topic author
john71
Posts: 694
Joined: 10.08.2016
With us: 4 years 9 months

Post #4by john71 » 29.10.2020, 14:14

Hi Goofy, "real" neural upscaling works very well, but these online versions in my opinion are not very good. Gimp can do the same with noise reduction. But it can be brutally effective, like old movies from the 1890s look very sharp.
Last edited by john71 on 03.03.2021, 14:03, edited 1 time in total.

Avatar
Goofy
Posts: 265
Joined: 30.08.2011
With us: 9 years 8 months
Location: Italy

Post #5by Goofy » 29.10.2020, 14:33

John 71, mine was just a try to understand what we are spelking of, and the result of this free commercial test was looking promising, and faster than Gimp or Photoshop... :think:
So we'll hope for "real" open source network scaling disponibility....

Goofy :wink:
"Something is always better than nothing!"
HP Omen 15-DC1040nl- Intel® Core i7 9750H, 2.6/4.5 GHz- 1TB PCIe NVMe M.2 SSD+ 1TB SATA 6 SSD- 32GB SDRAM DDR4 2666 MHz- Nvidia GeForce GTX 1660 Ti 6 GB

Topic author
john71
Posts: 694
Joined: 10.08.2016
With us: 4 years 9 months

Post #6by john71 » 29.10.2020, 14:38

That's OK, but try this one: https://www.youtube.com/watch?v=fo_eZuOTBNc

Avatar
Goofy
Posts: 265
Joined: 30.08.2011
With us: 9 years 8 months
Location: Italy

Post #7by Goofy » 29.10.2020, 17:37

Yes, I have already seen some of these restored old time movies.
Results are interesting and nice, even if, for my taste, I prefer them in original, even with all the characteristic defects of those first attempts of filmography.
Anyway, I found somewhere that Neural Enhancing is particularly useful for this kind of movies and for anime.
Will it be useful for images like the ones we use in Celestia, too?
Thank you.
Goofy :smile:
"Something is always better than nothing!"
HP Omen 15-DC1040nl- Intel® Core i7 9750H, 2.6/4.5 GHz- 1TB PCIe NVMe M.2 SSD+ 1TB SATA 6 SSD- 32GB SDRAM DDR4 2666 MHz- Nvidia GeForce GTX 1660 Ti 6 GB

Challenger007
Posts: 3
Joined: 29.10.2020
With us: 6 months 20 days

Post #8by Challenger007 » 30.10.2020, 10:55

Art Blos, I agree with you. the difference in picture quality is negligible. Perhaps it was worth taking a better quality source to make the final picture clearer.

mario.schinder
Posts: 7
Joined: 06.12.2020
Age: 43
With us: 5 months 12 days
Location: Miami

Post #9by mario.schinder » 07.12.2020, 08:53

That sounds like a nice idea actually, what I would do is something similar to these two ideas together:


* Random texture generation (like this random face generation apps)
* Randomness based on seed (something similar that happens with a world generated in Minecraft


So then, you have each planet/star/etc with a unique texture/map, with as many details as you want due to the IA factor

Topic author
john71
Posts: 694
Joined: 10.08.2016
With us: 4 years 9 months

Post #10by john71 » 07.12.2020, 10:09

In my opinion procedural textures are good, when there is no data at all, but I have never seen any procedural texture which can compete with real ones. Space Engine is a very good software but to be honest the procedural planets look like very detailed cartoons. Celestia feels REAL somehow.

mario.schinder
Posts: 7
Joined: 06.12.2020
Age: 43
With us: 5 months 12 days
Location: Miami

Post #11by mario.schinder » 08.12.2020, 10:49

I totally with you John, but I think procedural texture on Celestia fits perfectly, the point here is apart of the Solar system objects, outside we don't have a way to see how that really looks, and I remember they end up looking very similar...

so it would be amazing from the user experience point of view, having this option, so then you have the real sense of seeing different objects, not the same over and over (but just changing a little bit the color of the surface), but that is just my humble opinion :)

Topic author
john71
Posts: 694
Joined: 10.08.2016
With us: 4 years 9 months

Post #12by john71 » 08.12.2020, 11:30

I agree, but we have to remain on the ground of scientific realism. I don't like fairy tale planets with rainbow colored unreal textures, unless it is based on facts... :biggrin:

Added after 1 hour 23 minutes:
Maybe the developers should contact these guys: http://www.texturesforplanets.com/index.shtml

Avatar
Gurren Lagann
Posts: 321
Joined: 31.01.2018
Age: 14
With us: 3 years 3 months
Location: State of Rio de Janeiro, Brazil

Post #13by Gurren Lagann » 08.12.2020, 13:44

I remenber using this generator on the Noral System (or the Noral Era, in my timeline), around 2 years ago... Looks like its outdated in my standards today.
"The tomorrow we're trying to reach is not a tomorrow you had decided on!"
- Simon the Digger
"Nothing is impossible for me, as long I'm determinated to keep moving forward!"
"If other people aren't going to do it, I'm going to do it myself!"
- Me (Gurren)

Current major projects:
- Aur Cir
- Cel+
- Project Sisyphus
- Populating the Local Group
- An galaxy generator

Topic author
john71
Posts: 694
Joined: 10.08.2016
With us: 4 years 9 months

Post #14by john71 » 08.12.2020, 13:48

Gurren Lagann wrote:Looks like its outdated in my standards today.
I agree. If you have any other texture generator links please share it on this thread: https://celestia.space/forum/viewtopic.php?f=5&t=20530

mario.schinder
Posts: 7
Joined: 06.12.2020
Age: 43
With us: 5 months 12 days
Location: Miami

Post #15by mario.schinder » 08.12.2020, 13:57

well, actually I don't mean to put rainbow xDD, I was more in the direction of complementing it, meaning:

All the stars look exactly the same, even the same sunspots... but with different colors.... it would be great that respecting the color of the star, and the intensity of that, make some variations on those sunspots, or the surface itself, same for a rock if we cannot see the craters for an asteroid outside of the Pluton orbit, it can be complemented with different craters than others

Avatar
Askaniy
Posts: 62
Joined: 17.09.2017
With us: 3 years 8 months
Location: Saint Petersburg, Russia

Post #16by Askaniy » 03.03.2021, 09:15

I recently improved the Neptune map using AI and color calculated by my True Color Tools.
Now it has a 4K resolution instead of 1.5K

https://www.deviantart.com/askaniy/art/Neptune-1989-Texture-Map-769376373
neptune-1989.png
Celestia Origin project member; GitHub: github.com/Askaniy, DeviantArt: deviantart.com/askaniy

Topic author
john71
Posts: 694
Joined: 10.08.2016
With us: 4 years 9 months

Post #17by john71 » 03.03.2021, 14:04

Very nice!


Return to “Ideas & News”

Who is online