XP Scenery Generator [WIP]

[tonywob]

is it possible to make your software somehow allow range limits and draw details based on how high an airplane is?

 

It already does, each 3D model has a LOD which determines which parts are drawn from distances. So, a house model will say that it should no longer be drawn when it is 13km from the viewer, etc.. I'm not sure if height is a factor though, but either way it's not something W2XP can control. This increased visibility thing in 10.40 is generally not going to be good for this type of scenery, and once I get a beta I'll see how it goes (at heights where this is useful, W2XP is pretty useless anyway).

 

Does the Osm data contain fine-grained enough information to render these areas (and some intersections) more smoothly?

 

Yes, you can map in as much detail as you like. The issue is that most roads are done with GPX tracks recorded at set intervals, so the road is not smooth. People who map from satellite imagery also generally don't map in high detail. Another factor is that X-Plane's roads are too wide and only work well in the US style grid system, so small curved streets etc don't map too well. 

[jaemmerson]

Hi Tony, just a quick question - does the new beta include the autogen you mentioned in your looking forward post? I'm just wondering about exclusion zones and whether I should bother (default X-plane does have some houses mapped that aren't in OSM but it also puts forests in towns too!).

Thanks again, and great work!

Jamie

[tonywob]

Hi Jamie

 

No I'm afraid not, and the reason is that I don't have enough artwork for it. I only have a few buildings for the UK, and whilst it looks nice, I also need industrial and commercial doing (and that's just one small country). However, I also intend to post a UK based scenery using third-party data which will be detailed for the entire country (Not using OSM). However, due to the complexity of the process required to work with other data sources, I am only going to publish the sceneries and not the tools used to create it. 

 

Again, if somebody wants to help out with the artwork I'd really appreciate the help.

 

Once the autogen artwork becomes available, then people will be able to generate regions theirselves instead of using smart-exclusions.

 

Tony

[jaemmerson]

Thanks for the reply Tony. I'd be up for doing a bit if the learning curve isn't too hideous for a total newbie! I'd love to put something back in to the project even if it's not a huge amount. How would I get started? (I mean that in the more general sense of what sort of buildings you need within those categories, I'm reading your tutorials at the moment!)

 

That scenery you're producing sounds great - looking forward to that. Any ETA?

 

All the best,

 

Jamie

[tonywob]

That scenery you're producing sounds great - looking forward to that. Any ETA?

 

Well, I've just got a first look at the data (released today) and to be frank, it's not very good. I was expecting more detail, more woodland etc detail than what is currently available, but it's disappointing to say the least. Some of it is usable and a little better than previous, but I'll have to hunt down other sources. As before, they've done the bare minimum to qualify it as having open data, and it's a disappointment for anyone who has been waiting on this. Autogen seems to be the way to go here.

[jaemmerson]

That's a shame. If it's any consolation, the forests of the Thames valley are getting better by the day! Thanks again for all the work you're putting in.

[tonywob]

That's a shame. If it's any consolation, the forests of the Thames valley are getting better by the day! Thanks again for all the work you're putting in.

 

I generated the North of England using this data combined with OSM and the results were surprisingly good. Every single building in the entire country is there (from farms to entire towns), and it works really well, apart from the fact that things like terraced buildings are treated as one building, so you end up with an ugly facade instead of terraced houses. However, when you get above about 1500ft, the results are wonderful and it brings the scenery in the UK on par with that of the Netherlands and Germany. Of course, it's do detailed (and has facades) that the FPS take a beating.

 

If I can find a way to make it use the autogen models I've done (e.g. Filling up a single long building with smaller terraced houses), then I think it will work out well.

[jaemmerson]

That's great news. Are forests and other objects still an issue or have they been upgraded by this data too? 

[tonywob]

That's great news. Are forests and other objects still an issue or have they been upgraded by this data too? 

 

I'm now including the National Forestry database and also a species/habitat database which is much more detailed, but also indicates the type of woodland, i.e. Broadleaved, coniferous, shrub, mixed. I now have 5 different data sources running together to produce the scenery, and it's incredibly detailed and looks fantastic with photoscenery. However, OSM is still useful here as I've noticed it misses out some smaller areas.

[CaptCWGAllen]

Hi Tony,

Will simheaven host 0.7 at somepoint?

Thanks

Peter

[tonywob]

Peter

 

I don't know, I'm not even sure if Simheaven are doing scenery anymore or creating new ones. I will host the the UK scenery file generated from Ordnance Survey/NFD on my own website, but it's big, around 1GB, so will take ages to upload.

 

Tony

Edited March 28, 2015 by tonywob

[tonywob]

Here's a couple of pictures for the UK scenery (I've decided also to include Scotland in there, but no Northern Ireland as the data I have doesn't include it for some reason). 

 

 

 

 

If anyone has UK wide photo scenery e.g. (From G2XPL or Flight1'S VFR UK), they are in for a real treat. Every single building is shown, as well as forest/woodland (With the correct type of tree), as well as the usual stuff from OSM such as obstacles, wind farms. The data is merged with the information already in OSM, so you can still map your village in higher detail (e.g. Splitting up terraced buildings). But this solution gives us coverage of the entire country. I'm hunting down more data sources, and if anyone would like to see their country done and has some good data sources then let me know. (I'll do New Zealand next, as it has some good data for some of the major cities).

 

Performance wise (In my screenshots you can see the FPS which dropped when I took a screenshot). But on my laptop (Macbook Pro 15" 2014 Model), it averages between 20-30fps on max settings (I have a limit on 30). Flying over large cities will obviously give a FPS hit, so some people might need to turn down the settings to keep things smooth.

[CaptCWGAllen]

Wow Tony,

Absolutely fantastc. Lost for words. Thank you so much. Nice to see you up in my training plane

No worries about simheaven will get onto the w2xp site and sort it form there. Not looking hopeful for RW today so may get it done today (is that possible yet?) and have something not far off RW.

Thanks again - really exicted by this new release.

Peter

PS What object setting are you using?

Edited March 28, 2015 by CaptCWGAllen

[tonywob]

What object setting are you using?

 

These are max all max settings (Except shadows which kills everything). I'll upload the UK file as soon as it's finished generating, but it might take a while on my rubbish internet

[PilotBalu]

Hi Tony,

Will simheaven host 0.7 at somepoint?

Thanks

Peter

Sorry for not answering earlier, I am on a trip.

Yes, I will do all the countries and continents with the new beta 0.7 resp 0.7.1 and publish it at simheaven.com. Maybe then in the normal download area.

Sent via Tapatalk

[CaptCWGAllen]

These are max all max settings (Except shadows which kills everything). I'll upload the UK file as soon as it's finished generating, but it might take a while on my rubbish internet

Thanks Tony

[tonywob]

Yes, I will do all the countries and continents with the new beta 0.7 resp 0.7.1 and publish it at simheaven.com. Maybe then in the normal download area.

 

Great. When you're back let me know. I still have some users testing out 0.7.1 and reporting bugs, so to save you time let me know when you're back and I'll send you the latest patched version for doing the scenery. The application is no longer available for download on the website.

 

Also, if anyone here can help out and test some countries and report bugs then please let me know.

[HiFlyer]

Its a shame I can't really get into photo sceneries....... 

[CaptCWGAllen]

Sorry for not answering earlier, I am on a trip. Yes, I will do all the countries and continents with the new beta 0.7 resp 0.7.1 and publish it at simheaven.com. Maybe then in the normal download area. Sent via Tapatalk

Thank you - what fabulous community we have.

Peter

[tonywob]

Its a shame I can't really get into photo sceneries....... 

 

I can't use photosceneries when there is no 3D on top of it. They look ok when you get high enough, but I like to fly low-and-slow and objects/autogen is a must.

[HiFlyer]

I can't use photosceneries when there is no 3D on top of it. They look ok when you get high enough, but I like to fly low-and-slow and objects/autogen is a must.

 

Exactly. Most Photo Sceneries come with no 3D, and for me, that just doesn't cut it. The ones that do come with 3d....... well, the storage requirements and other fiddly things, I generally find discouraging, especially as some of the sites offering them can be glacially slow.

 

I wait patiently for a complete alternative, some day.

[tonywob]

I've uploaded a UK scenery based on third-party data here http://world2xplane....o-scenery-v0-1/ to try out and play with.

 

Instructions on how to install and the required libraries are included on the page. Please make sure you read the entire post carefully before downloading and trying it out. Have fun

[cptcaptain]

Today i tested the new version, but when i try to convert "us-west-latest" from geofrabrik.de i just get errors.
 
This is the log:
 

 

12:58:54.748 INFO  - Reading Config File E:\Downloads\World2XPlane-0.7.1\World2XPlane-0.7.1\application\resources\config.xml

12:58:54.996 INFO  - Added Facade Set simheaven_red

12:58:55.042 INFO  - Added Facade Set simheaven_black

12:58:55.074 INFO  - Added Facade Set w2xp

12:58:55.460 INFO  - Reading Regions

12:58:58.404 INFO  - Output Folder: E:\Downloads\World2Xplane\us-west-latest

12:59:09.805 INFO  - Using local storage.

12:59:10.067 INFO  - Skipping initial passes. Resuming

12:59:10.067 INFO  - Processing E:\Downloads\World2Xplane osm\us-west-latest.osm.pbf

12:59:10.632 INFO  - Processing 397 tiles

12:59:10.636 INFO  - Reading +39-104.dsf - (39'N,104'E)

12:59:10.636 INFO  - Reading +44-125.dsf - (44'N,125'E)

12:59:10.636 INFO  - Reading +39-102.dsf - (39'N,102'E)

13:00:25.396 INFO  - Reading +32-117.dsf - (32'N,117'E)

13:00:25.396 INFO  - Reading +39-103.dsf - (39'N,103'E)

13:00:25.396 INFO  - Reading +43-124.dsf - (43'N,124'E)

java.util.concurrent.ExecutionException: java.lang.AssertionError: data were not fully read, check your serializer 

at java.util.concurrent.FutureTask.report(Unknown Source)

at java.util.concurrent.FutureTask.get(Unknown Source)

at com.world2xplane.Parser.OSMProcess.buildScenery(OSMProcess.java:432)

at com.world2xplane.Parser.OSMProcess.process(OSMProcess.java:310)

at com.world2xplane.Parser.OSMProcess.process(OSMProcess.java:82)

at com.world2xplane.World2XPlane.run(World2XPlane.java:119)

at com.world2xplane.GUI.Worker.run(Worker.java:79)

Caused by: java.lang.AssertionError: data were not fully read, check your serializer 

at org.mapdb.Store.deserialize(Store.java:299)

at org.mapdb.StoreDirect.get2(StoreDirect.java:475)

at org.mapdb.StoreDirect.get(StoreDirect.java:428)

at org.mapdb.Caches$HashTable.get(Caches.java:246)

at org.mapdb.EngineWrapper.get(EngineWrapper.java:58)

at org.mapdb.HTreeMap.getInner(HTreeMap.java:458)

at org.mapdb.HTreeMap.get(HTreeMap.java:397)

at com.world2xplane.DataStore.JDBMStore.getRelationInfo(JDBMStore.java:158)

at com.world2xplane.Parser.OSMPBFTileProcessor.readWayInfo(OSMPBFTileProcessor.java:147)

at com.world2xplane.Parser.OSMPBFTileProcessor.parseWays(OSMPBFTileProcessor.java:198)

at org.openstreetmap.osmosis.osmbinary.BinaryParser.parse(BinaryParser.java:121)

at org.openstreetmap.osmosis.osmbinary.BinaryParser.handleBlock(BinaryParser.java:68)

at org.openstreetmap.osmosis.osmbinary.file.FileBlock.process(FileBlock.java:135)

at org.openstreetmap.osmosis.osmbinary.file.BlockInputStream.process(BlockInputStream.java:34)

at com.world2xplane.Parser.OSMProcess$Worker.call(OSMProcess.java:357)

at com.world2xplane.Parser.OSMProcess$Worker.call(OSMProcess.java:337)

at java.util.concurrent.FutureTask.run(Unknown Source)

at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)

at java.lang.Thread.run(Unknown Source)

java.lang.ArrayIndexOutOfBoundsException: -1

at org.apache.mahout.math.map.OpenIntObjectHashMap.rehash(OpenIntObjectHashMap.java:431)

at org.apache.mahout.math.map.OpenIntObjectHashMap.put(OpenIntObjectHashMap.java:384)

at com.world2xplane.Rules.FilterList.acceptsTag(FilterList.java:260)

at com.world2xplane.Rules.Rule.acceptsTag(Rule.java:305)

at com.world2xplane.Rules.GeneratorStore.acceptingRulesAndFilters(GeneratorStore.java:1772)

at com.world2xplane.Parser.OSMPBFTileProcessor.parseDense(OSMPBFTileProcessor.java:105)

at org.openstreetmap.osmosis.osmbinary.BinaryParser.parse(BinaryParser.java:124)

at org.openstreetmap.osmosis.osmbinary.BinaryParser.handleBlock(BinaryParser.java:68)

at org.openstreetmap.osmosis.osmbinary.file.FileBlock.process(FileBlock.java:135)

at org.openstreetmap.osmosis.osmbinary.file.BlockInputStream.process(BlockInputStream.java:34)

at com.world2xplane.Parser.OSMProcess$Worker.call(OSMProcess.java:357)

at com.world2xplane.Parser.OSMProcess$Worker.call(OSMProcess.java:337)

at java.util.concurrent.FutureTask.run(Unknown Source)

at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)

at java.lang.Thread.run(Unknown Source)

13:01:39.524 INFO  - Reading +39-106.dsf - (39'N,106'E)

13:01:39.524 INFO  - Reading +32-119.dsf - (32'N,119'E)

13:01:39.524 INFO  - Reading +39-105.dsf - (39'N,105'E)

13:01:58.652 INFO  - Reading +47-110.dsf - (47'N,110'E)

13:02:51.047 INFO  - Reading +43-104.dsf - (43'N,104'E)

13:02:51.047 INFO  - Reading +36-123.dsf - (36'N,123'E)

 

 

[tonywob]

Thanks, what doesn't make sense from the log file is why it is trying to process lots of tiles all at the same time. Did you change anything in your config file, or how many cores did you set inside the advanced tab in GUI? It should be set to 1 by default. It looks like it just tried to generate all of them in one go and went splat!

[cptcaptain]

I took the "config-hd+autogen.xml", and i did not change the cores. It was set to 3. I'll try it again with 1 core. Should i resume or start all over?

Edited April 7, 2015 by cptcaptain