Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Glittering Blue (glittering.blue)
455 points by netinstructions on Jan 27, 2016 | hide | past | favorite | 94 comments


I made this, and I’m happy to answer questions. (And to politely ignore contentious remarks about how I characterized GOES-R.)


I'd love to have something like this as an animated desktop wallpaper - but it should be moving much slower. Are you aware of a movie file that I could use for this?


I wrote a script that downloads the live (well, every 10 minutes, with 30 minutes delay) tiles from the himawari-8 website and update my background with it. Gnome is nice enough that it refreshes the background when the configured image changes.

I'm waiting for the solar eclipse in March, it should be (indirectly) visible. http://www.timeanddate.com/eclipse/solar/2016-march-9


Sounds nice, do you have it up somewhere?


Now on https://github.com/glandium/himawari-wallpaper (I'm not actually sure the eclipse will be visible on the cut I'm using)


Thanks!


Try xplanet.

Xplanet can render to the background and keep an updated view of earth. At some point I obsessed over having current cloud cover images overlaid and that looked really nice. It can even render sun reflections.


Thanks for the super informative FAQ in Credits/About - for others visiting the site, be sure not to miss it on top left!


Thanks! This was increadable to watch over and over again. I'm so used to highly compressed video, that the detail in this was staggering.

Is there a good public reasonably live feed of this data? I found the 800x800 8 bit pngs, and I found information on the restricted access full sized 103 gigabyte per day feed.


Is there a good public reasonably live feed of this data?

Right here: http://himawari8.nict.go.jp


How awesome would it be if we had that kind if quality available from all "sides"... (Ok, yes, one could mostly build displays of blue spheres. But fancy ones ;))


Any reason why we don't have several of these at all points?; or do we and I just do not know about it? - p.s. love the site, thank you


Europe’s weather authorities are extremely stingy with their nearest equivalent data – their attitude is that the observations are for science or for money, not for silly websites.

Feel free to provide an email address for us to complain.


Click "Credits/About" on the OP.


Fantastic! Thank you! I've cropped several as desktop wall paper.


Why not make a cron job that does that automatically every couple minutes ;)


That's the plan! It just need to be intelligent enough to find interesting lighting.


There's another satellite, DCSOVR, that takes photos of the daylight side of the earth several times a day. It's not as up-to-date as this footage, but it's always fully lit. http://epic.gsfc.nasa.gov/


Wow, DSCOVR. typo


In addition to the link posted by celoyd, you can get access to the full data stream you mentioned by filling out this application form[0].

There are also some heavily processed images from that data available from NOAA[1] - the "Geocolor Full Disk" is the best, it's half-resolution (5500x5500). The green filter on Himawari's camera doesn't correctly capture the green color of vegetation, which is why OP's video looks browner than you might expect. So this product attempts to correct for that by creating an artificial green channel made of a combination of other channels[2]. It also attempts to correct for Rayleigh scattering[3], so this is basically what the Earth would look like if the atmosphere suddenly disappeared (except for the clouds :P). The night portions of these images are a different kind of false color composite: the clouds come from two infrared channels, white are high ice clouds and red are low wet clouds; the city lights are (sadly) just a static overlay from existing data.

And (shameless plug) I've been playing with applying motion interpolation algorithms to these NOAA images to create smooth, high resolution video that can be played much slower. The Farneback optical flow algorithm[4][5] seems to work very well. (Lots of) videos available on my Youtube channel[6], code/details available here[7][8], blog post coming soon :)

[0] http://www.eorc.jaxa.jp/ptree/registration_top.html [1] http://rammb.cira.colostate.edu/ramsdis/online/himawari-8.as... [2] http://www.goes-r.gov/downloads/ScienceWeek/2015/Presentatio... [3] http://rammb.cira.colostate.edu/research/goes-r/proving_grou... [4] http://www.diva-portal.org/smash/get/diva2:273847/FULLTEXT01... [5] https://github.com/dthpham/butterflow [6] https://www.youtube.com/watch?v=6rOwjn87edI&list=PLrmCQL5hEL... [7] https://github.com/dandelany/animate-earth [8] http://www.unmannedspaceflight.com/index.php?showtopic=8063&...


Wow. Great stuff! Is there a good way to use one a video at a very low framerate (perhaps 0.1-1 fps) with low resource requirements as animated wallpaper on Ubuntu/Linux?


Oh, hello! I enjoyed your motion interpolation experiments, and I look forward to the blog post.


Awesome work and thanks for the helpful links. Would make a really cool background / screensaver to loop the prior days imagery in HD :)


This is great, but it would be nice if there were a way to slow it down a bit.


document.querySelector('video').playbackRate = 0.1;


Cool demo. On my machine though (high-dpi monitor, win10, firefox) the globe is enormous and way too big for the browser viewport. If I zoom out enough with ctrl-minus it is about the right size, so I think you're sizing the page elements incorrectly in some sort of dpi-unaware fashion. Can probably work around this with devicePixelRatio.


I know it’s odd, but I wanted it not to be visible all at once.


FWIW, I really appreciated this. I think it helped add to the feeling of enormity, and helped me to realize the resolution of the video.


FWIW I don't think ‘enormity’ means what you think it does!

‘Enormity’ refers to severe moral transgression, like you could say, “It wasn't until after the war had ended that the German people became aware of the enormity of Hitler's concentration camps…” That's closer to what the word means.


I appreciate that choice, but maybe add a zoom out button to notify people that you can in fact zoom out, because I didn't even realize I could see the whole earth (Also, this made the 'what is that bright spot moving east to west' question very confusing).


<ctrl>-

Repeat as necessary.

Went too far?

<ctrl>+

When done, <ctrl>0

(on chrome at least)


Thanks for making it! I tried a little with your scripts and got to these results: (original files available if you ask)

1 Day in 4400x4400: https://www.youtube.com/watch?v=m4_orOM8zOg

1 Month: https://www.youtube.com/watch?v=NwN2KJcQfoQ

11000x11000 Sunset: https://i.imgur.com/wMIXQvC.jpg

11000x11000 Daylight: http://i.imgur.com/y1zTyU2.jpg


How come you pointed it at Australia and not NZ :(

Also, it'd be nice to be able to pause it and really take in the colours.


https://s3.amazonaws.com/hi8/v/2015-08-03.mp4

There's the raw video. Added bonus is that it actually fits in the full browser window when viewed directly.


Thanks. It's a 2200x2200 24fps H.264 video (33MB).


Also, it'd be nice to be able to pause it and really take in the colors.

You can zoom in on the NICT browser: http://himawari8.nict.go.jp

Their color mix is more cloud-oriented, so it’s darker, but at least the image quality is higher than the video’s.


In Firefox at least the context menu includes "Pause".


Beautiful, thanks for sharing.


Beautiful! Well done.


From the about page:

> "Europe’s weather authorities are extremely stingy with their nearest equivalent data – their attitude is that the observations are for science or for money, not for silly websites."

What a terrible attitude we have here. We don't even have the climate change excuse because that attitude doesn't exist here. I did a bit of Googling, it seems that Eumetsat is the agency responsible:

http://www.eumetsat.int/website/home/AboutUs/index.html

If anyone is interested in drafting a letter with me, asking why our taxpayers' money is being used and the benefits not shared openly, please get in touch. Email in my profile.


In the US we have NOAA for weather. I found about about them when they were being sued by some private forecasters (accuweather I think) for giving away forecast data on the web. (We used to have a weather band radio which would just broadcast the forecast).

The government site [1] is ad free and is very accurate and free from local hype. To the local media snow = ratings. (I bike a lot so I'm a weather watcher). My main complaint is their use of ALL CAPS in the detailed weather discussion[2]

Getting a stream of data from NOAA wasn't so easy for global locations, hourly so when my company needed it we paid weather underground which has a lat/long -> json weather condition api.[3] its was free for developers and small sites and its fun to play around with.

[0]http://graphical.weather.gov/xml/rest.php [1]http://www.weather.gov [2]http://forecast.weather.gov/product.php?site=BOX&issuedby=BO... [3]http://www.wunderground.com/weather/api/


You can get limited data from NOAA (METAR) through ADDS: https://aviationweather.gov/adds/dataserver

Here's an example for Moscow: https://aviationweather.gov/adds/dataserver_current/httppara...

If you need forecasts, NDFD appears to have both SOAP and REST services that are updated hourly: http://graphical.weather.gov/xml/rest.php


Wikipedia doesn't mention a lawsuit, but they do mention a Senate bill drafted by Rick Santorum after some palm greasing by AccuWeather: https://en.wikipedia.org/wiki/National_Weather_Service_Dutie...


I've also found the NOAA forecast discussions to be head and shoulders above anything similar.


Be sure to read the (long) explanation and more details linked in the page: https://glittering.blue/about


Reading the about page really makes me hope that private efforts to launch mini/nano satellites actually works out. It would be supremely awesome to have easily accessible data & imagery of our planet, rather than have it locked up due to politics and bureaucracy.


> Reading the about page really makes me hope that private efforts to launch mini/nano satellites actually works out

That sounds like a good idea, but it gives me Kessler Syndrome anxiety. We already have a bit of space debris on our hands


I made a script that sets the latest image from Himawari-8 as your desktop background - new picture of Earth every 10 mins!

https://gist.github.com/jarmitage/5042bfe20aa54b3d8dc8


Not a massive issue, but in Chrome if you scroll so that the credits/about link is over the Earth, you can no longer click it.

Adding a z-index property set to 1 in the CSS fixes it for me in Chrome.


Done. Thank you!


Black screen except for "Loading 0%" in the corner on Android.


Black screen here, too (although the loading text went from 0 to 100%) on Firefox 44 on Windows 7.


I had the same problem on FF44 and Win7, but it worked fine on Chrome on Windows and OSX, worth firing up Chrome to check out, IMHO.


Sorry. If there’s one thing I’ve learned from this project, it’s that video support is hard.

I’m happy to take advice (preferably in the form of ffmpeg flags).


What were your ffmpeg flags to begin with?


It’s based on the example for 2-pass encoding, with tweaks for things like QuickTime support: https://gist.github.com/celoyd/90cc919105248a2ddc95


Worked fine for me on FF44 on Mac.


The Earth looks so .. crisp and clean from afar.

Mesmerizing.


> The moon does appear occasionally, dimly – it’s made of rock about as dark as asphalt.

That's what I've always found fascinating in discussions about what's the true color of the moon. I know the fact, and I still have trouble picturing an asphalt moon. No-one I told that believed me.


So is it freshly-poured asphalt black or well-worn asphalt grey? How can its color be compared to something on earth? Doesn't the (lack of) atmosphere have some effect?


Well-worn gray: https://en.wikipedia.org/wiki/Albedo

It’s a loose comparison, since both asphalt and the moon’s surface vary. Plus, there are tricky things like specular reflection and the opposition effect.

How can its color be compared to something on earth? Doesn't the (lack of) atmosphere have some effect?

You can hold a moon rock up against something on Earth. Or you can look at Earth and the moon from a distance with the same sensor, which is what Himawari-8 is doing.

The atmosphere does affect things: A huge plain of moon rocks on Earth’s surface would look bluer (hazier) than the moon would in the same picture from Himawari-8 (or an Apollo Hasselblad, etc.). And a moon rock in sunlight on Earth will look slightly yellower than one in the same light on the moon. But your eyes are constantly adapting to the surrounding illumination. Color perception is really complicated.


If you have any problem with loading the page, here is the direct link to the MP4: https://s3.amazonaws.com/hi8/v/2015-08-03.mp4


From the FAQ:

What’s the light-colored border in the water around some continents?

Several things. The turquoise in the tropics ... is shallow water – we’re seeing bright sand under a relatively thin layer of ocean. Around China, it’s air pollution from coal power ...


On firefox, all I see is a part of a sphere (earth?) that gets somewhat illuminated. Laoding stops at 10% .... nothing else happens. What is is supposed to do?


It's supposed to load to 100% (zing!)

Seriously though, works fine in FF here, and shows a beautifully rendered loop of the earth.


A legitimate firefox bug?

Firefox did this for me too, so I started investigating the glitch. Chrome worked just fine. Overall, this sort of thing would happen to me occasionally (and my colleagues) with h.264 <video> elements: it's some kind of a freaky and infuriating bug. I can't explain it, but I suspected the actual problem was with the original network transmission and a client-side caching mechanism, possibly aggravated by server-side caching mechanisms. Reason why I thought that is below, but now I'm not so sure: I copied that Earth video to a private server and it froze at the same exact spot, albeit it got less frames parsed/decoded/presented/painted than I put below during the S3 render.

Last project I was working on had MP4 files (h.264 encoded) hosted on an iron server, with varnish-cache configured for streaming (streaming config was an attempt to troubleshoot the glitch.) During the development I must have previewed the work-in-progress hundreds of times so I initially chalked the behavior up to caching freaking out. After resetting cache manually or pulling up the file and shift-refreshing, things would work fine for awhile. Attempting to reset cache doesn't fix the stalled Earth video.

The video files I was previously working with were 2-4 mb in size, nearly as 'small' as some larger higher quality images, so I don't think filesize triggered the issue. The ultimate fix for my project was to superstitiously switch from directly-hosting MP4 files to move them to akamai's CDN because that had worked in the past without an observed glitch. I can't explain why this eliminated the problem, but it did (or I just stopped looking at the project): I imagine akamai has a whole bag of tricks up their sleeves, and at that point I was so done with the problem that I didn't care.

That is, I didn't care until I saw this glitch again just hours ago and realized it wasn't just me and my shoddy work that made it happen. So, I pulled up the direct MP4 video of this earth loop (hosted on S3), and pulled up stats for it (right click on video menu). The video was supposed to be 12 seconds long, but it only loaded about 2, letting me see same thing you did before the playback froze. The video stats read the following:

    Media:            2015-08-03.mp4
    Size:             2200x2200 scaled to 1085x1085
    Activity:         Ended
    Volume:           100%
    readyState:       HAVE_CURRENT_DATA
    networkState:     NETWORK_IDLE
    Frames parsed:    2030
    Frames decoded:   1696
    Frames presented: 189
    Frames painted:   168
Despite this info dump, firebug revealed (or claimed) that around 32 MB of the file was transmitted. I hit play and the video stopped at 2 seconds. ffprobe claims that nb_frames is 278 (24 * 11.583333), rounded up. So where the heck are the other 89 frames, firefox?? When copying this video to my slower private server, even fewer frames were presented/painted.

Any firefox devs around?


OH! It's summer in the Northern Hemisphere on that picture. That's why the day seems so damn short if you're watching Australia.


...and why there is no night at the north pole.

This cannot be mid summer though, because a larger area to the north should be continuously illuminated then -- the part above the arctic circle.

Living north of the arctic circle makes nice summers, reading in bed without any lamp, but sucks at winter.


The New York Times published an interactive about this new satellite in July: http://www.nytimes.com/interactive/2015/07/10/science/An-Ima...


I also get a loading 0%. OSX Chrome.

From the page src:

// [Not like piano music.](http://achewood.com/index.php?date=11082002)

I'm intrigued but don't understand the comic.


Himawari 8 is some 35K kilometers away from Earth (moon is 380K km). It doesn't appear that far away just by looking at the satellite pictures.


Beautiful + fascinating + mesmerizing.


This makes me want to play KSP. ;-)


Oh! So the sun IS really rotating around the Earth. The church was right all along then...


I wonder how has he hacked God's webcam.



Very cool. But, you forgot to model the lightning :) Especially visible at night.


And you forgot to read the "about" page. :) It's not a rendering, it's pictures of the planet.


This is why I love the internet. Thank you for making this!


on the about page:

"My friend believes Earth is flat and people never landed on the moon. How do I use this video to convince them otherwise?"

unfortunately, the answer is 100% true.


No, its him being a smart ass. He has never received that email but it allows him to straw man any opponents. Because @!#!$$!@ love science!


Nice work, sir.


the hurricanes are really cool looking


I think mucker's excellent comment deserves to be listed under yours:

> to say you won't discuss contentious remarks after being pointedly contentious is really, pathetically bad form. If you dish it out, be prepared to take it.


We detached this subthread from https://news.ycombinator.com/item?id=10977731 and marked it off-topic.


I think they’re just responding to my joke with a joke ;)


I didn't find it a joke and the votes indicate others took it seriously (down votes are serious).


Avoid the about page, it's unnecessarily loaded with flame bait political commentary.


I thought the about page was rather good and the political points interesting.

tl;dr he argues we can get this data from a Japanese satellite rather than US ones because the climate denial folk have blocked funding.

In linked material:

>[the House of Representatives, led by Republicans] slashed Earth science funding by $260 million and added extra money for planetary science that the agency did not ask for. For example, nasa requested $30 million for a robotic mission to Jupiter's icy moon, Europa, but the House gave it $140 million.


I initially only glanced at the about page without reading it, but after I saw your comment, I went back and read the whole thing. Most of it is just (interesting IMO) info about the site and the technology behind it.


Nice stuff...except for the about page.

"but our federal science budget is controlled by climate denialists who dishonestly impede Earth observation because environmental science embarrasses them."

Uh no. The House voted not to spend money on a Vice Presidents dream of a beautiful 38 million dollar picture. Now you can argue that it has merit, but even the NY Times (http://www.nytimes.com/1999/06/01/science/politics-keeps-a-s...) leaves that question, quite rightfully, hanging.

And to say you won't discuss contentious remarks after being pointedly contentious is really, pathetically bad form. If you dish it out, be prepared to take it.


Casual readers may not get your reference – the idea for DSCOVR literally came to Al Gore in a dream. I still think this is hilarious.

One can indeed argue that DSCOVR has merit, and people including climate scientists do. (Though arguably it’s really too early to judge either way until there’s time for publications to come out of its data.) Earth’s radiation budget is surprisingly underdetermined, considering its importance.

But it’s certainly a fair criticism of DSCOVR as launched that it’s not state-of-the-art. That’s because it was delayed for reasons of politics, only loosely disguised as reasons of science.

The only places I’d push back on your remarks are:

1. The “Uh no”, which is unsubstantiated (perhaps just facetious, but I’m sensitive because I supported my point relatively laboriously, with the links); and

2. the idea that the NYT should refrain from pointing out political interference in science funding.


38 million was loose change, even in 1998. We spent far more teaching abstinence (with little to no effect) to school children that year.


Which is why I linked directly to a NY Times peace that gives a fairly balanced discussion of the same.

And it is not fair to claim that it was, "only loosely disguised as reasons of science." The reasons given, in both the Inspector General's report and in the article that I linked to are political reasons of _budget_.

It is not unsubstantiated as I substantiate it via link. I'm also a person that opposed the launch. As others point out, it wasn't _fabulously_ expensive in comparative scale, but in a very stretched NASA budget I would prefer all the pennies thrown at a mars exploration, a permanent moon base, a better space station, or a new shuttle program over a really cool camcorder inspired by a VP's (very literal) dream. That isn't science so much as something bordering on dictatorial whim.

Nor, _anywhere_ do I claim the NYT should somehow not report on science funding. I link directly to it to refute _your_ comments. The NYT article does not support your claim, instead it gives a much more reasonable account of the funding issue. It mentions the dream, the funding, and doesn't resort to slurs.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: