New SWBD Specular Map

Post requests, images, descriptions and reports about work in progress here.
Avatar
Topic author
cartrite
Posts: 1978
Joined: 15.09.2005
With us: 19 years
Location: Pocono Mountains, Pennsylvania, USA Greate Grandfother from Irshava, Zakarpattia Oblast Ukraine

New SWBD Specular Map

Post #1by cartrite » 10.11.2007, 07:50

I created a specular map from SWBD files that can be used instead of the Watermask files at the BMNG server. It still needs data north of 60 degrees latitude and south of 60 degrees. I'm not sure how this will be done yet. The details on how it was created are at the Celestial Matters Forum in the thread http://forum.celestialmatters.org/viewtopic.php?t=114. Here are some screenshots I took.

Image
Image
Image
Image
Image
Image

As soon as I can I'll upload the binary file to my site. It is currently DOWN. or somewhere else?
cartrite
VivoBook_ASUSLaptop X712JA_S712JA Intel(R) UHD Graphics 8gb ram. Intel(R) Core(TM) i5-1035G1 CPU @ 1.00GHz, 1190 Mhz, 4 Core(s), 8 Logical Processor(s) 8 GB ram. Running on Windows 11 and OpenSuse 15.4

Avatar
Topic author
cartrite
Posts: 1978
Joined: 15.09.2005
With us: 19 years
Location: Pocono Mountains, Pennsylvania, USA Greate Grandfother from Irshava, Zakarpattia Oblast Ukraine

Post #2by cartrite » 10.11.2007, 16:02

Okay, It's uploaded. This file is meant to be used with the F-tex tool tx2rgba.
I got over 300kbs download. The site goes down a lot so if there is no connection try again later.
cartrite
VivoBook_ASUSLaptop X712JA_S712JA Intel(R) UHD Graphics 8gb ram. Intel(R) Core(TM) i5-1035G1 CPU @ 1.00GHz, 1190 Mhz, 4 Core(s), 8 Logical Processor(s) 8 GB ram. Running on Windows 11 and OpenSuse 15.4

Johaen
Posts: 341
Joined: 14.01.2006
With us: 18 years 8 months
Location: IL, USA

Re: New SWBD Specular Map

Post #3by Johaen » 10.11.2007, 16:23

cartrite wrote:It still needs data north of 60 degrees latitude and south of 60 degrees.


By this you mean that north and south of those lines, there will be no specularity at all? Is this different from the watermask on the BMNG server?
AMD Athlon X2 4400+; 2GB OCZ Platinum RAM; 320GB SATA HDD; NVidia EVGA GeForce 7900GT KO, PCI-e, 512MB, ForceWare ver. 163.71; Razer Barracuda AC-1 7.1 Gaming Soundcard; Abit AN8 32X motherboard; 600 watt Kingwin Mach1 PSU; Windows XP Media Center SP2;

Avatar
Topic author
cartrite
Posts: 1978
Joined: 15.09.2005
With us: 19 years
Location: Pocono Mountains, Pennsylvania, USA Greate Grandfother from Irshava, Zakarpattia Oblast Ukraine

Post #4by cartrite » 10.11.2007, 16:35

By this you mean that north and south of those lines, there will be no specularity at all? Is this different from the watermask on the BMNG server?

Within the landmasses north of 60 and south of 60 there is no specular data except for coastlines. There are oceans and coastlines from 60n to 90n and 60s to 90s. There are previews at my site which show what the binary file looks like.
cartrite
VivoBook_ASUSLaptop X712JA_S712JA Intel(R) UHD Graphics 8gb ram. Intel(R) Core(TM) i5-1035G1 CPU @ 1.00GHz, 1190 Mhz, 4 Core(s), 8 Logical Processor(s) 8 GB ram. Running on Windows 11 and OpenSuse 15.4

Johaen
Posts: 341
Joined: 14.01.2006
With us: 18 years 8 months
Location: IL, USA

Post #5by Johaen » 10.11.2007, 16:37

cartrite wrote:Within the landmasses north of 60 and south of 60 there is no specular data except for coastlines. There are oceans and coastlines from 60n to 90n and 60s to 90s.


Ah. I understand now. I'll have to take a look and try them out when I get a chance.
AMD Athlon X2 4400+; 2GB OCZ Platinum RAM; 320GB SATA HDD; NVidia EVGA GeForce 7900GT KO, PCI-e, 512MB, ForceWare ver. 163.71; Razer Barracuda AC-1 7.1 Gaming Soundcard; Abit AN8 32X motherboard; 600 watt Kingwin Mach1 PSU; Windows XP Media Center SP2;

danielj
Posts: 1477
Joined: 15.08.2003
With us: 21 years 1 month

Post #6by danielj » 11.11.2007, 03:15

Pretty interesting!
But I don??t have the SLIGHTEST idea what SWBD stands for!Or even how to use it... :?

BobHegwood
Posts: 1803
Joined: 12.10.2007
With us: 16 years 11 months

Post #7by BobHegwood » 11.11.2007, 03:33

Another stupid question from the Brain-Dead...

Are specular maps used with dry land masses? I know that they are
used to manipulate reflections on water and possibly ice, but do dry
land masses require some control of specularity also?

Thanks, Bob
Brain-Dead Geezer Bob is now using...
Windows Vista Home Premium, 64-bit on a
Gateway Pentium Dual-Core CPU E5200, 2.5GHz
7 GB RAM, 500 GB hard disk, Nvidia GeForce 7100
Nvidia nForce 630i, 1680x1050 screen, Latest SVN

Avatar
t00fri
Developer
Posts: 8772
Joined: 29.03.2002
Age: 22
With us: 22 years 6 months
Location: Hamburg, Germany

Post #8by t00fri » 11.11.2007, 11:16

BobHegwood wrote:Another stupid question from the Brain-Dead...

Are specular maps used with dry land masses? I know that they are
used to manipulate reflections on water and possibly ice, but do dry
land masses require some control of specularity also?

Thanks, Bob


Yes, one uses a black mask for the land masses to make sure that there the specular reflection is NIL ! White means total reflection, in contrast.

Actually my specular masks typically use just a little rest light (0.12), which enhances the details from the normalmap rendering (without making the surface look like plastic)...

I just made such a specmap using cartrite's new, much improved 84k swbd-watermap, added 0.12 of rest light, OR-ed it with the ocean boundaries determined from elevation=0 in the srtm-elevation map, added it as alpha channel to the BMNG basemap, cut the compound into VT tiles ....and --after 20 minutes-- I am now playing happily with the result!

All quickly done with my F-TexTools.

Bye Fridger

PS: for people wanting to try this as well: cartrite's 84k swbd-watermap is INVERTED relative to the official BMNG watermap! So you got to recompile my 'specmap' tool in the F-TexTools package, with one trivial modification

Code: Select all

hspec[i] |= ~  (unsigned char) hwater[i];

=>

hspec[i] |=  (unsigned char) hwater[i];


Skipping that '~' has the effect of not inverting the input watermap (cartrite did it already!)
Image

Avatar
Topic author
cartrite
Posts: 1978
Joined: 15.09.2005
With us: 19 years
Location: Pocono Mountains, Pennsylvania, USA Greate Grandfother from Irshava, Zakarpattia Oblast Ukraine

Post #9by cartrite » 11.11.2007, 11:33

PS: for people wanting to try this as well: cartrite's 84k swbd-watermap is INVERTED relative to the official BMNG watermap! So you got to recompile my 'specmap' tool in the F-TexTools package, with one trivial modification

Hi Fridger,
I'm going to have to try running one the way you did. With specmap tool. I started by running tx2rgba. I'm not sure what you mean by INVERTED though. I didn't have to do anything special to run tx2rgba. ????
I used the program png2bin for the final conversion to binary. The png map "looked" fine before I ran png2bin ??
cartrite
Last edited by cartrite on 11.11.2007, 11:56, edited 1 time in total.
VivoBook_ASUSLaptop X712JA_S712JA Intel(R) UHD Graphics 8gb ram. Intel(R) Core(TM) i5-1035G1 CPU @ 1.00GHz, 1190 Mhz, 4 Core(s), 8 Logical Processor(s) 8 GB ram. Running on Windows 11 and OpenSuse 15.4

Avatar
Topic author
cartrite
Posts: 1978
Joined: 15.09.2005
With us: 19 years
Location: Pocono Mountains, Pennsylvania, USA Greate Grandfother from Irshava, Zakarpattia Oblast Ukraine

Post #10by cartrite » 11.11.2007, 11:45

danielj,
SWBD = SRTM Water Body Data
Before you ask, SRTM = Shuttle Radar Topography Mission
It is a specular map. Water is white. Land is Black.
The specular map is making the river systems and lakes or oceans "stand out" or "shine" in the images I posted above.
cartrite
VivoBook_ASUSLaptop X712JA_S712JA Intel(R) UHD Graphics 8gb ram. Intel(R) Core(TM) i5-1035G1 CPU @ 1.00GHz, 1190 Mhz, 4 Core(s), 8 Logical Processor(s) 8 GB ram. Running on Windows 11 and OpenSuse 15.4

Avatar
t00fri
Developer
Posts: 8772
Joined: 29.03.2002
Age: 22
With us: 22 years 6 months
Location: Hamburg, Germany

Post #11by t00fri » 11.11.2007, 12:05

danielj wrote:Pretty interesting!
But I don??t have the SLIGHTEST idea what SWBD stands for!Or even how to use it... :?


Daniel,

if you try looking swbd up in Google you might come up with

swbd = switchboard ;-)

For earth there are various sources for elevation data
SRTM3, GTOPO30/SRTM30 and ETOPO2. SRTM3 are the best. That's why you see always the acronym srtm when we speak of elevations...and normalmaps.

For Earth, water bodies (rivers, lakes, ocean boundaries,..) are supplied by SWBD, GSHHS and VMAP0 data sets. So,

WBD = WaterBodyData, aha! ;-)

Each of them comes in a different data format. Like all new SRTM data, SWBD come in 1?°x1?° tiles.

Therefore they have first to be assembled into one big file. However SWBD involves a special so-called vector format, i.e. rivers etc are encoded as polygons, admitting a VERY high resolution. In order to be useful for Celestia maps, that vector format has first to be converted into the appropriate raster format. This is kind of tedious and time consuming.

cartrite just achieved this for the highest rsolution of 84k.

GREAT!

So now the new much better watermap can be used to make new super textures with the F-TexTools.

Much respective discussion you will find over in CM, here

http://forum.celestialmatters.org/viewt ... 14&start=0

and in a new thread by cartrite, here

http://forum.celestialmatters.org/viewt ... 48&start=0

We are currently discussing, how to make this conversion process professionally sound, such that henceforth the new watermap can replace the bad, old BMNG one at a scientific level. Reto Stoeckli from NASA is VERY interested in this issue as well...As he wrote to me recently, they did not attempt this tedious process of raster conversion of the SWBD data simple because of lack of manpower!

Another present issue is the fact that the hires SWBD data extend only from -60 to + 60 degrees in latitude. So a substitute is required for the more polar regions.
These questions have to be discussed and solved ...

Bye Fridger
Image

Avatar
t00fri
Developer
Posts: 8772
Joined: 29.03.2002
Age: 22
With us: 22 years 6 months
Location: Hamburg, Germany

Post #12by t00fri » 11.11.2007, 12:12

cartrite wrote:
PS: for people wanting to try this as well: cartrite's 84k swbd-watermap is INVERTED relative to the official BMNG watermap! So you got to recompile my 'specmap' tool in the F-TexTools package, with one trivial modification
Hi Fridger,
I'm going to have to try running one the way you did. With specmap tool. I started by running tx2rgba. I'm not sure what you mean by INVERTED though. I didn't have to do anything special to run tx2rgba. ????
I used the program png2bin for the final conversion to binary. The png map "looked" fine before I ran png2bin ??
cartrite


Your map is fine if you use it just with tx2rgba! But I used your map in 'specmap' first to logically OR it with the ocean boundaries from srtm and inject some rest light (0.12) . In the distributed 'specmap' an inversion of the input watermap takes place ('~') which is needed if the BMNG watermap is used. It is NOT needed, if your new one is used.

So I first applied 'specmap' and THEN tx2rgba.

That's all.

Cheers,
Fridger
Image

bh
Posts: 1547
Joined: 17.12.2002
With us: 21 years 9 months
Location: Oxford, England

Post #13by bh » 11.11.2007, 12:18

Most interesting... hopefully should get started on tex tools sometime this week!
regards...bh.

ANDREA
Posts: 1543
Joined: 01.06.2002
With us: 22 years 3 months
Location: Rome, ITALY

Post #14by ANDREA » 11.11.2007, 13:50

Fridger, cartrite, perhaps it could be interesting to see the new spec-watermap applied to these regions,

Image
lake Meade and western side of Gran Canyon, AZ

Image
and northern part of Tunisia

both at local noon time, whose we spoke in the Celestial Matters Forum, here:
http://forum.celestialmatters.org/viewt ... c&start=75
In those images most of white spots should not to be there!
I would like to see same images both both by cartrite, with his 84k swbd-watermap map from SWBD using tx2rgba only, and from Fridger, using the same cartrite's 84k but with "added 0.12 of rest light, OR-ed it with the ocean boundaries determined from elevation=0 in the srtm-elevation map, added it as alpha channel to the BMNG basemap, cut the compound into VT tiles" using full F.Textools capabilities.
Can we see the new ones, please?
This will give a clear idea of the real improvement obtained this way, IMHO.
Thans a lot!
Bye

Andrea :D
"Something is always better than nothing!"
HP Omen 15-DC1040nl- Intel® Core i7 9750H, 2.6/4.5 GHz- 1TB PCIe NVMe M.2 SSD+ 1TB SATA 6 SSD- 32GB SDRAM DDR4 2666 MHz- Nvidia GeForce GTX 1660 Ti 6 GB-WIN 11 PRO

Avatar
t00fri
Developer
Posts: 8772
Joined: 29.03.2002
Age: 22
With us: 22 years 6 months
Location: Hamburg, Germany

Post #15by t00fri » 11.11.2007, 14:53

Andrea,

Please have a look at CM, there I will display truely spectacular shots with the new VT's. In about 15 minutes the post will be completed in CM.

Here is what you get at level5 with the new specmap based on cartrite's work:

Tunesia:

Image

Lake Meade:

Image




Cheers,
Fridger
Image

ANDREA
Posts: 1543
Joined: 01.06.2002
With us: 22 years 3 months
Location: Rome, ITALY

Post #16by ANDREA » 11.11.2007, 15:04

t00fri wrote:Andrea, Please have a look at CM, there I will display truely spectacular shots with the new VT's. In about 15 minutes the post will be completed in CM.
Cheers,
Fridger

Wow, wow and wow again!!! 8O
Absolutely wonderful!
A big "WELL DONE" to cartrite and you, for all the time and experience you both used to obtain such a stuff for all of us.
VERY APPRECIATED INDEED!
Cannot wait to see the full post and images in Celestial Matters Forum, see you there! :wink:
Bye

Andrea :D
"Something is always better than nothing!"
HP Omen 15-DC1040nl- Intel® Core i7 9750H, 2.6/4.5 GHz- 1TB PCIe NVMe M.2 SSD+ 1TB SATA 6 SSD- 32GB SDRAM DDR4 2666 MHz- Nvidia GeForce GTX 1660 Ti 6 GB-WIN 11 PRO

Avatar
Topic author
cartrite
Posts: 1978
Joined: 15.09.2005
With us: 19 years
Location: Pocono Mountains, Pennsylvania, USA Greate Grandfother from Irshava, Zakarpattia Oblast Ukraine

Post #17by cartrite » 11.11.2007, 15:20

ANDREA,
Your Welcome.
Fridger beat me to it. :wink: I also took snapshots of the areas but couldn't logon to imageshack. His look better anyhow. I've yet to process the specmap with the specmap tool so my bmng doesn't have the rest light at (0.12) yet. Have to do that soon.
EDIT:The file is updated and is also available here. http://www.celestialmatters.org/users/c ... ermask.zip
Many Thanks to rthorvald.
SO......keep in mind. If you are intending to use the specmap tool from F-TexTools toolkit use the file Watermask. If your looking for a specmap for whatever reason, use the file called Landmask. The Landmask file is only available at my site.
cartrite 8O 8O 8O 8O 8O
Last edited by cartrite on 11.11.2007, 21:32, edited 2 times in total.
VivoBook_ASUSLaptop X712JA_S712JA Intel(R) UHD Graphics 8gb ram. Intel(R) Core(TM) i5-1035G1 CPU @ 1.00GHz, 1190 Mhz, 4 Core(s), 8 Logical Processor(s) 8 GB ram. Running on Windows 11 and OpenSuse 15.4

Avatar
Topic author
cartrite
Posts: 1978
Joined: 15.09.2005
With us: 19 years
Location: Pocono Mountains, Pennsylvania, USA Greate Grandfother from Irshava, Zakarpattia Oblast Ukraine

Post #18by cartrite » 11.11.2007, 20:30

I updated my site to contain 2 files. The original file I uploaded is a ready to use specmap. I have renamed it to SWBD_Landmask.zip. An updated file called SWBD_Watermask.zip is inverted. That is the water is black and the land is white. Fridger's F-Tex tool, specmap, should work properly with the SWBD_Watermask file without modifying it and rebuilding. The SWBD_Watermask is the file you want to use if you intend to use that tool.
cartrite
VivoBook_ASUSLaptop X712JA_S712JA Intel(R) UHD Graphics 8gb ram. Intel(R) Core(TM) i5-1035G1 CPU @ 1.00GHz, 1190 Mhz, 4 Core(s), 8 Logical Processor(s) 8 GB ram. Running on Windows 11 and OpenSuse 15.4

bh
Posts: 1547
Joined: 17.12.2002
With us: 21 years 9 months
Location: Oxford, England

Post #19by bh » 11.11.2007, 20:41

We have truly entered the realm of cartography... super job!
regards...bh.

Avatar
Topic author
cartrite
Posts: 1978
Joined: 15.09.2005
With us: 19 years
Location: Pocono Mountains, Pennsylvania, USA Greate Grandfother from Irshava, Zakarpattia Oblast Ukraine

Post #20by cartrite » 21.11.2007, 02:18

I just published some pages at Celestial Matters. The Stephen page and the SWBD Watermask page contain more information about the methods used, previews, links, and information about how this file was created. http://www.celestiaproject.net/forum/viewtopic ... 5977#95977
cartrite
VivoBook_ASUSLaptop X712JA_S712JA Intel(R) UHD Graphics 8gb ram. Intel(R) Core(TM) i5-1035G1 CPU @ 1.00GHz, 1190 Mhz, 4 Core(s), 8 Logical Processor(s) 8 GB ram. Running on Windows 11 and OpenSuse 15.4


Return to “Add-on development”