Using the Nmtools package

General discussion about Celestia that doesn't fit into other forums.
bh
Posts: 1547
Joined: 17.12.2002
With us: 21 years 11 months
Location: Oxford, England

Post #81by bh » 12.01.2007, 08:00

Johaen...very impressive...NZ is particularly nice. Well done. I'm green!
regards...bh.

danielj
Posts: 1477
Joined: 15.08.2003
With us: 21 years 3 months

Post #82by danielj » 13.01.2007, 17:21

SORRY.I deleted everything.I will not do ANYMORE any normal map by myself.I tryed to follow a modem tutorial and lost my conection at home,so now I??m only a FINAL END-USER!Everything I try to do,I spoil everything.I know NOTHING about vcomputers and that??s all...


t00fri wrote:
danielj wrote:I change the gzip to C partition.
Change the directory to C:\GnuWin32\bin and then type gzip -f,but received the message:"gzip: stdin: Not enough space"
What can I do,now?
Is it to download the binaries,too?

Daniel,

why do you type "gzip -f " ?? ' f ' means ' force '. You want to type instead

gzip -dc <srtm_ramp2.world.86400x43200.bin.gz|...

which opens the STDIN channel (c parameter) and unpacks (d parameter) the inflowing srtm_ramp2.world.86400x43200.bin.gz file.

Note, the dots ' ...' behind the pipe operator | are NOT to be typed literally ;-). It just is to indicate that there should be further commands, as detailed in my tutorial!

Daniel, you are always acting erratically. How about concentrating a bit more? Also you first have to find out, of course, how much space you have left on your C-partition. This can be done with a proper Windows command, which I hope you know!! At least all Windows (click) commands should be known by "endusers" ;-) . There is plenty of literature about the use of Windows to read and profit from.


Bye Fridger

Fightspit
Posts: 510
Joined: 15.05.2005
With us: 19 years 6 months

Post #83by Fightspit » 14.01.2007, 13:29

t00fri wrote:Firefox supports all sorts of amazing add-ons,
one being called "DownThemAll".


I just installed this addon and its very impressive :!:

My xDSL line is 18Mbits/sec. and I get ~ 1.5 Mbytes/sec (before I can't download more than 700-800 kbytes/sec because of server's limitation...):!:
Thanks Fridger for talking about this addon and everybody should use this addon :!:
Motherboard: Intel D975XBX2
Processor: Intel Core2 E6700 @ 3Ghz
Ram: Corsair 2 x 1GB DDR2 PC6400
Video Card: Nvidia GeForce 8800 GTX 768MB GDDR3 384 bits PCI-Express 16x
HDD: Western Digital Raptor 150GB 10000 rpm
OS: Windows Vista Business 32 bits

Avatar
selden
Developer
Posts: 10192
Joined: 04.09.2002
With us: 22 years 2 months
Location: NY, USA

Post #84by selden » 14.01.2007, 13:46

You should be aware that many Web sites block access by download accelerators. Accelerators try to open many separate connections in parallel, tying up resources on the server, making it less usable for others.
Selden

Avatar
Topic author
t00fri
Developer
Posts: 8772
Joined: 29.03.2002
Age: 22
With us: 22 years 7 months
Location: Hamburg, Germany

Post #85by t00fri » 14.01.2007, 13:48

Fightspit wrote:
t00fri wrote:Firefox supports all sorts of amazing add-ons,
one being called "DownThemAll".

I just installed this addon and its very impressive :!:

My xDSL line is 18Mbits/sec. and I get ~ 1.5 Mbytes/sec (before I can't download more than 700-800 kbytes/sec because of server's limitation...):!:
Thanks Fridger for talking about this addon and everybody should use this addon :!:


Of course this only works for people that have a higher line speed than the (artificially) limited speed of the server in question.

You have a VERY fast line, hence you will profit ENORMOUSLY! Notably if the server speed is limited to something like 1-2 Mbit/sec which still happens quite frequently! You should also rise the maximum number of chunks in the option dialog of DownThemAll to 10 or even higher! Suppose the server has 1Mbit/sec limitation while the user has a 10Mbit/sec line. Then the add-on will download 10 chunks each with 1Mbit/sec such that your EFFECTIVE speed is VERY close to 10Mbit/sec, your theoretical value!

Bye Fridger
Image

Avatar
Topic author
t00fri
Developer
Posts: 8772
Joined: 29.03.2002
Age: 22
With us: 22 years 7 months
Location: Hamburg, Germany

Post #86by t00fri » 14.01.2007, 13:54

selden wrote:You should be aware that many Web sites block access by download accelerators. Accelerators try to open many separate connections in parallel, tying up resources on the server, making it less usable for others.


Still DownThemAll works for MANY such cases. In case of commercial sites (and many "free sites" are effectively commercial without saying so ;-) ) I have no hesitations, since they just want to make more money by saving on server investment despite exploiting the informations they are getting from me and millions of others....

Bye Fridger
Image

Fightspit
Posts: 510
Joined: 15.05.2005
With us: 19 years 6 months

Post #87by Fightspit » 14.01.2007, 14:07

Sorry, you confuse (I think) about bit and byte ;)

Code: Select all

1 byte = 8 bits


So 18 Mbits = ~ 2 Mbytes theorical (that I never get it :wink: )
Motherboard: Intel D975XBX2
Processor: Intel Core2 E6700 @ 3Ghz
Ram: Corsair 2 x 1GB DDR2 PC6400
Video Card: Nvidia GeForce 8800 GTX 768MB GDDR3 384 bits PCI-Express 16x
HDD: Western Digital Raptor 150GB 10000 rpm
OS: Windows Vista Business 32 bits

Avatar
Topic author
t00fri
Developer
Posts: 8772
Joined: 29.03.2002
Age: 22
With us: 22 years 7 months
Location: Hamburg, Germany

Post #88by t00fri » 14.01.2007, 15:02

Fightspit wrote:Sorry, you confuse (I think) about bit and byte ;)

Code: Select all

1 byte = 8 bits


So 18 Mbits = ~ 2 Mbytes theorical (that I never get it :wink: )


That would be horrible if I didn't know the difference. ;-)
No I don't see where I wrote something incorrect.

The rule is that one can get to something like 10% less than the theoretical speed, depending on various optimization parameters.

My example was entirely in Mbits NOT MBytes. My line is e.g. 6Mbits/sec for download which corresponds to 750KByte/sec. With DownThemAll and 10 possible chunks I get typically to max 720 KByte/sec, for example. Your nominal line speed is 3 times as high. So you might want to increase the maximum number of chunks above 10.

Bye Fridger
Image

Fightspit
Posts: 510
Joined: 15.05.2005
With us: 19 years 6 months

Post #89by Fightspit » 15.01.2007, 14:50

I thought you are talking about my ~ 1Mbytes download but about 1Mbits of server's upload.
It would be better if I must learn to read slowly post writen in english :roll:
Motherboard: Intel D975XBX2
Processor: Intel Core2 E6700 @ 3Ghz
Ram: Corsair 2 x 1GB DDR2 PC6400
Video Card: Nvidia GeForce 8800 GTX 768MB GDDR3 384 bits PCI-Express 16x
HDD: Western Digital Raptor 150GB 10000 rpm
OS: Windows Vista Business 32 bits

danielj
Posts: 1477
Joined: 15.08.2003
With us: 21 years 3 months

Post #90by danielj » 18.01.2007, 14:19

Didn??t you realize that I say I will NO LONGER build my own normal map because I spoil everything.If so,why no one did any comment.I am a final end user and it will be a pity if ?

bh
Posts: 1547
Joined: 17.12.2002
With us: 21 years 11 months
Location: Oxford, England

Post #91by bh » 18.01.2007, 14:27

Maybe someone will make one for you.
regards...bh.

Avatar
Topic author
t00fri
Developer
Posts: 8772
Joined: 29.03.2002
Age: 22
With us: 22 years 7 months
Location: Hamburg, Germany

Post #92by t00fri » 18.01.2007, 17:16

Anyway, I would not be pleased to see normalmaps produced with my nmtools on the Motherlode (..., just since Daniel claims to be unable to complete this simple task of using the nmtools.).

This would sabotage the whole "plot" behind this project ;-) and would CERTAINLY prevent me to publish the planned further tools for doing the corresponding 64k base texture and spec map.

As I pointed out earlier, I cannot legally prevent anyone to place such a normalmap on the Motherlode, but I can stop publishing my further software of which many users (except Daniel!) would definitely profit.

Bye Fridger
Image

ANDREA
Posts: 1543
Joined: 01.06.2002
With us: 22 years 5 months
Location: Rome, ITALY

Post #93by ANDREA » 06.03.2007, 17:15

Thanks to the very detailed manual issued by Fridger, after founding a sufficient time to read, translate and understand it, now I have a wonderful set of png normalmaps produced with nmtools.
Not being satisfied of the actual 1.5 release, so still using the well checked 1.4.1 for all my shows, I tried the new png normalmaps together with Jestr's JMII DDS 64k Earth, his 32k EarthNight and 32k Specular Map.
Well, the thing works, and the result is absolutely wonderful, IMHO.
This is an example, using the usual Chilean three lakes region in South America:

Image

And this even if Jestr's 64k Earth is from BM, not BMNG sets! 8O
Cannot wait Fridger's release of his new tool for texture maps, having so the possibility to have the BMNG textures linked to the 64k normalmaps.
Wow!.
Meanwhile, thank you Fridger, very appreciated. :wink:
Bye

Andrea :D

PS: sorry for editing, but first issue was due to a mistake between "Preview" and "Submit" buttons :oops:
Last edited by ANDREA on 06.03.2007, 22:10, edited 1 time in total.
"Something is always better than nothing!"
HP Omen 15-DC1040nl- Intel® Core i7 9750H, 2.6/4.5 GHz- 1TB PCIe NVMe M.2 SSD+ 1TB SATA 6 SSD- 32GB SDRAM DDR4 2666 MHz- Nvidia GeForce GTX 1660 Ti 6 GB-WIN 11 PRO

Avatar
Topic author
t00fri
Developer
Posts: 8772
Joined: 29.03.2002
Age: 22
With us: 22 years 7 months
Location: Hamburg, Germany

Post #94by t00fri » 06.03.2007, 18:26

Hi Andrea,

it's always nice to see that I didn't spend my time for nothing! Congratulations!!

Before I can publish my tools, I still need some

+++++++++++++++++++++++
MAC volunteers for testing

the still inofficial brand-new DeVIL-1.6.8RC3 library for MACS, that one of my tools needs. Also my tools have to be compiled as MAC-universal binaries (ppc and Intel MACS).
++++++++++++++++++++++++

Let me know if you know your MAC reasonably well and want to contribute a bit!

For Windows and Linux the DeVIL-1.6.8RC2 lib is available for download and very easy to install. The compiling I have done myself. The tools will again come with a Setup installer for Windows.

The remaining 4 tools do not need any libraries.

I need the DeVIL lib for DXT5nm compressing and also for my fast DXT1..3 compression and the mounting tool for "RGB base tex + spec tex" -> RGBA

Bye Fridger
Image

ANDREA
Posts: 1543
Joined: 01.06.2002
With us: 22 years 5 months
Location: Rome, ITALY

Post #95by ANDREA » 06.03.2007, 18:37

t00fri wrote:Hi Andrea, it's always nice to see that I didn't spend my time for nothing! Congratulations!!
No, you didn't waste your time, at least with me. :wink:
t00fri wrote:Bye Fridger

Take your time, Fridger, meanwhile I'm downloading just now June and December
world.200406.3x86400x43200.bin.gz
world.200412.3x86400x43200.bin.gz
BMNG files (2.3 GB each), so that I'll be ready to try the new tools, when available.
Thank you once again.
Bye

Andrea :D
"Something is always better than nothing!"
HP Omen 15-DC1040nl- Intel® Core i7 9750H, 2.6/4.5 GHz- 1TB PCIe NVMe M.2 SSD+ 1TB SATA 6 SSD- 32GB SDRAM DDR4 2666 MHz- Nvidia GeForce GTX 1660 Ti 6 GB-WIN 11 PRO

bh
Posts: 1547
Joined: 17.12.2002
With us: 21 years 11 months
Location: Oxford, England

Post #96by bh » 06.03.2007, 19:20

Superb... stunning!
regards...bh.

tech2000
Posts: 258
Joined: 14.02.2006
Age: 52
With us: 18 years 9 months
Location: Skepplanda, Sweden

VT generating shell script problem..

Post #97by tech2000 » 19.04.2007, 14:44

Hi, I have written a small shell script that uses Fridgers nmtools and that generates a set of dxt5nm/PNG tiles. I do have a small problem though. The ctx and ssc files that are generated out of the script contains a trash character at eof. why is that? Anyone...

vtgen.bat

Code: Select all

rem ------------------------------------------------------------------------
rem  This script will generate a set of dxt5nm/PNG normalmaps for Celestia.
rem ------------------------------------------------------------------------
rem  Goto options: dxt5nm or png
goto dxt5nm

:dxt5nm
prompt $g
@echo off
echo.
cls

echo.
echo This will generate a set VT's in dxt5nm format from level 0 to level 5.
echo (1.480.691.760 bytes)
echo.
echo.
echo Preparing 64k RAW image from Nasa - srtm_ramp2.world.86400x43200.bin.gz.
echo.

echo on
gzip -dc < srtm_ramp2.world.86400x43200.bin.gz | resc2pow2 86400 1 > world64k.bin
@echo off

echo.
echo Halfsize RAW file, 64k to 32k image.
echo.

echo on
halfsize 65536 < world64k.bin > world32k.bin
@echo off

echo.
echo Generating dxt5nm level 5 tiles.
echo.

echo on
nmstiles 5 6378.140 65536 2.5 < world64k.bin
nvdxt -quality_highest -file *.ppm -nomipmap -dxt5nm
@echo off

ren *.dds *.dxt5nm
del /q world64k.bin
del /q *.ppm

echo.
echo Moving dxt5nm level 5 tiles to Earth Normal.
mkdir "Earth Normal"
mkdir level5
move *.dxt5nm level5
move level5 "Earth Normal"

echo.
echo Halfsize RAW file, 32k to 16k image.
echo.

echo on
halfsize 32768 < world32k.bin > world16k.bin
@echo off

echo.
echo Generating dxt5nm level 4 tiles.
echo.

echo on
nmstiles 4 6378.140 32768 2.5 < world32k.bin
nvdxt -quality_highest -file *.ppm -nomipmap -dxt5nm
@echo off

ren *.dds *.dxt5nm
del /q world32k.bin
del /q *.ppm

echo.
echo Moving dxt5nm level 4 files to Earth Normal.
mkdir level4
move *.dxt5nm level4
move level4 "Earth Normal"

echo.
echo Halfsize RAW file, 16k to 8k image.
echo.

echo on
halfsize 16384 < world16k.bin > world8k.bin
@echo off

echo.
echo Generating dxt5nm level 3 tiles.
echo.

echo on
nmstiles 3 6378.140 16384 2.5 < world16k.bin
nvdxt -quality_highest -file *.ppm -nomipmap -dxt5nm
@echo off

ren *.dds *.dxt5nm
del /q world16k.bin
del /q *.ppm

echo.
echo Moving dxt5nm level 3 tiles to Earth Normal.
mkdir level3
move *.dxt5nm level3
move level3 "Earth Normal"

echo.
echo Halfsize RAW file, 8k to 4k image.
echo.

echo on
halfsize 8192 < world8k.bin > world4k.bin
@echo off

echo.
echo Generating dxt5nm level 2 tiles.
echo.

echo on
nmstiles 2 6378.140 8192 2.5 < world8k.bin
nvdxt -quality_highest -file *.ppm -nomipmap -dxt5nm
@echo off

ren *.dds *.dxt5nm
del /q world8k.bin
del /q *.ppm

echo.
echo Moving dxt5nm level 2 tiles to Earth Normal.
mkdir level2
move *.dxt5nm level2
move level2 "Earth Normal"

echo.
echo Halfsize RAW file, 4k to 2k image.
echo.

echo on
halfsize 4096 < world4k.bin > world2k.bin
@echo off

echo.
echo Generating dxt5nm level 1 tiles.
echo.

echo on
nmstiles 1 6378.140 4096 2.5 < world4k.bin
nvdxt -quality_highest -file *.ppm -nomipmap -dxt5nm
@echo off

ren *.dds *.dxt5nm
del /q world4k.bin
del /q *.ppm

echo.
echo Moving dxt5nm level 1 tiles to Earth Normal.
mkdir level1
move *.dxt5nm level1
move level1 "Earth Normal"

echo.
echo Generating dxt5nm level 0 tiles.
echo.

echo on
nmstiles 0 6378.140 2048 2.5 < world2k.bin
nvdxt -quality_highest -file *.ppm -nomipmap -dxt5nm
@echo off

ren *.dds *.dxt5nm
del /q world2k.bin
del /q *.ppm

echo.
echo Moving dxt5nm level 0 tiles to Earth Normal.
mkdir level0
move *.dxt5nm level0
move level0 "Earth Normal"

echo.
echo Generating directory structure.
echo.

mkdir hires
move "Earth Normal" hires

rem Generating the ctx file for dxt5nm tiles.
echo VirtualTexture {> _normal1
echo         ImageDirectory "Earth Normal"> _normal2
echo         BaseSplit 0> _normal3
echo         TileSize 1024> _normal4
echo         TileType "dxt5nm"> _normal5
echo }> _normal6

copy _normal1+_normal2+_normal3+_normal4+_normal5+_normal6 "Earth Normal.ctx"
del _normal*
rem
goto end

:png
prompt $g
@echo off
echo.
cls

echo.
echo This will generate a set VT's in PNG format Normalmaps from level 0 to level 5.
echo (904.969.477 bytes)
echo.
echo.
echo Preparing 64k RAW image from Nasa - srtm_ramp2.world.86400x43200.bin.gz.
echo.

echo on
gzip -dc < srtm_ramp2.world.86400x43200.bin.gz | resc2pow2 86400 1 > world64k.bin
@echo off

echo.
echo Halfsize RAW file, 64k to 32k image.
echo.

echo on
halfsize 65536 < world64k.bin > world32k.bin
@echo off

echo.
echo Generating PNG level 5 tiles.
echo.

echo on
nmstiles 5 6378.140 65536 2.5 < world64k.bin
nconvert -out png *.ppm
@echo off

del /q world64k.bin
del /q *.ppm

echo.
echo Moving PNG level 5 tiles to Earth Normal.
mkdir "Earth Normal"
mkdir level5
move *.png level5
move level5 "Earth Normal"

echo.
echo Halfsize RAW file, 32k to 16k image.
echo.

echo on
halfsize 32768 < world32k.bin > world16k.bin
@echo off

echo.
echo Generating PNG level 4 tiles.
echo.

echo on
nmstiles 4 6378.140 32768 2.5 < world32k.bin
nconvert -out png *.ppm
@echo off

del /q world32k.bin
del /q *.ppm

echo.
echo Moving PNG level 4 files to Earth Normal.
mkdir level4
move *.png level4
move level4 "Earth Normal"

echo.
echo Halfsize RAW file, 16k to 8k image.
echo.

echo on
halfsize 16384 < world16k.bin > world8k.bin
@echo off

echo.
echo Generating PNG level 3 tiles.
echo.

echo on
nmstiles 3 6378.140 16384 2.5 < world16k.bin
nconvert -out png *.ppm
@echo off

del /q world16k.bin
del /q *.ppm

echo.
echo Moving dxt5nm level 3 tiles to Earth Normal.
mkdir level3
move *.png level3
move level3 "Earth Normal"

echo.
echo Halfsize RAW file, 8k to 4k image.
echo.

echo on
halfsize 8192 < world8k.bin > world4k.bin
@echo off

echo.
echo Generating PNG level 2 tiles.
echo.

echo on
nmstiles 2 6378.140 8192 2.5 < world8k.bin
nconvert -out png *.ppm
@echo off

del /q world8k.bin
del /q *.ppm

echo.
echo Moving PNG level 2 tiles to Earth Normal.
mkdir level2
move *.png level2
move level2 "Earth Normal"

echo.
echo Halfsize RAW file, 4k to 2k image.
echo.

echo on
halfsize 4096 < world4k.bin > world2k.bin
@echo off

echo.
echo Generating PNG level 1 tiles.
echo.

echo on
nmstiles 1 6378.140 4096 2.5 < world4k.bin
nconvert -out png *.ppm
@echo off

del /q world4k.bin
del /q *.ppm

echo.
echo Moving PNG level 1 tiles to Earth Normal.
mkdir level1
move *.png level1
move level1 "Earth Normal"

echo.
echo Generating dxt5nm level 0 tiles.
echo.

echo on
nmstiles 0 6378.140 2048 2.5 < world2k.bin
nconvert -out png *.ppm
@echo off

del /q world2k.bin
del /q *.ppm

echo.
echo Moving PNG level 0 tiles to Earth Normal.
mkdir level0
move *.png level0
move level0 "Earth Normal"

echo.
echo Generating directory structure.
echo.

mkdir hires
move "Earth Normal" hires

rem Generating the ctx file for PNG tiles.
echo VirtualTexture {> _normal1
echo         ImageDirectory "Earth Normal"> _normal2
echo         BaseSplit 0> _normal3
echo         TileSize 1024> _normal4
echo         TileType "png"> _normal5
echo }> _normal6

copy _normal1+_normal2+_normal3+_normal4+_normal5+_normal6 "Earth Normal.ctx"
del _normal*
rem

:end
move "Earth Normal.ctx" hires

mkdir textures
move hires textures

mkdir Earth
move textures Earth

rem Generating the ssc file.
echo AltSurface "Earth" "Sol/Earth" {> _ssc1
echo    NormalMap "Earth Normal.ctx"> _ssc2
echo }> _ssc3

copy _ssc1+_ssc2+_ssc3 Earth.ssc
del _ssc*
rem

move Earth.ssc Earth

echo.
echo VT's successfully generated.
echo.
echo done!
prompt $p$g

tech2000
Posts: 258
Joined: 14.02.2006
Age: 52
With us: 18 years 9 months
Location: Skepplanda, Sweden

Post #98by tech2000 » 19.04.2007, 15:02

Both this files gets a trash character at a last line.

Code: Select all

rem Generating the ctx file for PNG tiles.
echo VirtualTexture {> _normal1
echo         ImageDirectory "Earth Normal"> _normal2
echo         BaseSplit 0> _normal3
echo         TileSize 1024> _normal4
echo         TileType "png"> _normal5
echo }> _normal6

copy _normal1+_normal2+_normal3+_normal4+_normal5+_normal6 "Earth Normal.ctx"
del _normal*
rem
 
rem Generating the ssc file.
echo AltSurface "Earth" "Sol/Earth" {> _ssc1
echo    NormalMap "Earth Normal.ctx"> _ssc2
echo }> _ssc3

copy _ssc1+_ssc2+_ssc3 Earth.ssc
del _ssc*
rem

steffens
Posts: 162
Joined: 06.11.2003
With us: 21 years
Location: RP Germany

Post #99by steffens » 19.04.2007, 15:32

I don't know much about Windows scripting, bu you might try something like

Code: Select all

rem Generating the ctx file for PNG tiles.
echo VirtualTexture {> EarthNormal.ctx
echo         ImageDirectory "Earth Normal">> EarthNormal.ctx
echo         BaseSplit 0>> EarthNormal.ctx
echo         TileSize 1024>> EarthNormal.ctx
echo         TileType "png">> EarthNormal.ctx
echo }>> EarthNormal.ctx

to append to the file instead of writing each line to a seperate file and then copy them all together.

steffens

Avatar
selden
Developer
Posts: 10192
Joined: 04.09.2002
With us: 22 years 2 months
Location: NY, USA

Post #100by selden » 19.04.2007, 16:02

What do you mean by "trash character"? Exactly what is it?

DOS format files always end with one or more Ctrl-Z (ASCII End-Of-File) characters and the remainder of that disk block should be filled with nulls.
Selden


Return to “Celestia Users”