Comments on: Code http://clearclimatecode.org Sun, 11 Dec 2011 14:35:43 +0000 hourly 1 http://wordpress.org/?v=3.2.1 By: drj http://clearclimatecode.org/code/comment-page-1/#comment-4957 drj Thu, 06 Jan 2011 09:04:14 +0000 http://clearclimatecode.org/?page_id=99#comment-4957 @clearscience: ah... no? @clearscience: ah… no?

]]> By: clearscience http://clearclimatecode.org/code/comment-page-1/#comment-4946 clearscience Wed, 05 Jan 2011 20:42:59 +0000 http://clearclimatecode.org/?page_id=99#comment-4946 So they (google) will be shutting down the mailing list? So they (google) will be shutting down the mailing list?

]]> By: Jorge Kampmann http://clearclimatecode.org/code/comment-page-1/#comment-2825 Jorge Kampmann Mon, 19 Jul 2010 18:01:56 +0000 http://clearclimatecode.org/?page_id=99#comment-2825 gistemp 0.5.0 still has this strange behaviour ...: kampmann@ibk-node14:~/Projekte/GlobalWarming/ccc-giss 0.5.0/ccc-gistemp-0.5.0> python tool/run.py MISSING: input/antarc1.list MISSING: input/antarc1.txt MISSING: input/antarc2.list MISSING: input/antarc2.txt MISSING: input/antarc3.list MISSING: input/antarc3.txt MISSING: input/t_hohenpeissenberg_200306.txt_as_received_July17_2003 MISSING: input/ushcn2.tbl MISSING: input/ushcnV2_cmb.tbl MISSING: input/mcdw.tbl MISSING: input/ushcn2.tbl MISSING: input/sumofday.tbl MISSING: input/v2.inv MISSING: input/oisstv2_mod4.clim.gz MISSING: input/v2.mean MISSING: input/ushcnv2 MISSING: input/SBBX.HadR2 Attempting to fetch missing files: antarc1.list antarc1.txt antarc2.list antarc2.txt antarc3.list antarc3.txt t_hohenpeissenberg_200306.txt_as_received_July17_2003 ushcn2.tbl ushcnV2_cmb.tbl mcdw.tbl ushcn2.tbl sumofday.tbl v2.inv oisstv2_mod4.clim.gz v2.mean ushcnv2 SBBX.HadR2 Extracting members from http://data.giss.nasa.gov/gistemp/sources/GISTEMP_sources.tar.gz ... Traceback (most recent call last): File "tool/run.py", line 225, in sys.exit(main()) File "tool/run.py", line 172, in main preflight.checkit(sys.stderr) File "/home/kampmann/Projekte/GlobalWarming/ccc-giss 0.5.0/ccc-gistemp-0.5.0/tool/preflight.py", line 103, in checkit fetch.main(argv=['fetch'] + missing) File "/home/kampmann/Projekte/GlobalWarming/ccc-giss 0.5.0/ccc-gistemp-0.5.0/tool/fetch.py", line 405, in main fetch(args) File "/home/kampmann/Projekte/GlobalWarming/ccc-giss 0.5.0/ccc-gistemp-0.5.0/tool/fetch.py", line 219, in fetch handler[hname](group, prefix, output) File "/home/kampmann/Projekte/GlobalWarming/ccc-giss 0.5.0/ccc-gistemp-0.5.0/tool/fetch.py", line 262, in fetch_tar compression_type=tar_compression_type) File "/home/kampmann/Projekte/GlobalWarming/ccc-giss 0.5.0/ccc-gistemp-0.5.0/tool/fetch.py", line 348, in fetch_from_tar tar = tarfile.open('', mode='r|%s' % compression_type, fileobj=inp) File "/usr/lib/python2.5/tarfile.py", line 1046, in open _Stream(name, filemode, comptype, fileobj, bufsize)) File "/usr/lib/python2.5/tarfile.py", line 352, in __init__ self._init_read_gz() File "/usr/lib/python2.5/tarfile.py", line 439, in _init_read_gz raise ReadError("not a gzip file") tarfile.ReadError: not a gzip file kampmann@ibk-node14:~/Projekte/GlobalWarming/ccc-giss 0.5.0/ccc-gistemp-0.5.0> could you explain or help? Thanks Jörg gistemp 0.5.0 still has this strange behaviour …:
kampmann@ibk-node14:~/Projekte/GlobalWarming/ccc-giss 0.5.0/ccc-gistemp-0.5.0> python tool/run.py
MISSING: input/antarc1.list
MISSING: input/antarc1.txt
MISSING: input/antarc2.list
MISSING: input/antarc2.txt
MISSING: input/antarc3.list
MISSING: input/antarc3.txt
MISSING: input/t_hohenpeissenberg_200306.txt_as_received_July17_2003
MISSING: input/ushcn2.tbl
MISSING: input/ushcnV2_cmb.tbl
MISSING: input/mcdw.tbl
MISSING: input/ushcn2.tbl
MISSING: input/sumofday.tbl
MISSING: input/v2.inv
MISSING: input/oisstv2_mod4.clim.gz
MISSING: input/v2.mean
MISSING: input/ushcnv2
MISSING: input/SBBX.HadR2
Attempting to fetch missing files: antarc1.list antarc1.txt antarc2.list antarc2.txt antarc3.list antarc3.txt t_hohenpeissenberg_200306.txt_as_received_July17_2003 ushcn2.tbl ushcnV2_cmb.tbl mcdw.tbl ushcn2.tbl sumofday.tbl v2.inv oisstv2_mod4.clim.gz v2.mean ushcnv2 SBBX.HadR2
Extracting members from http://data.giss.nasa.gov/gistemp/sources/GISTEMP_sources.tar.gz …
Traceback (most recent call last):
File “tool/run.py”, line 225, in
sys.exit(main())
File “tool/run.py”, line 172, in main
preflight.checkit(sys.stderr)
File “/home/kampmann/Projekte/GlobalWarming/ccc-giss 0.5.0/ccc-gistemp-0.5.0/tool/preflight.py”, line 103, in checkit
fetch.main(argv=['fetch'] + missing)
File “/home/kampmann/Projekte/GlobalWarming/ccc-giss 0.5.0/ccc-gistemp-0.5.0/tool/fetch.py”, line 405, in main
fetch(args)
File “/home/kampmann/Projekte/GlobalWarming/ccc-giss 0.5.0/ccc-gistemp-0.5.0/tool/fetch.py”, line 219, in fetch
handler[hname](group, prefix, output)
File “/home/kampmann/Projekte/GlobalWarming/ccc-giss 0.5.0/ccc-gistemp-0.5.0/tool/fetch.py”, line 262, in fetch_tar
compression_type=tar_compression_type)
File “/home/kampmann/Projekte/GlobalWarming/ccc-giss 0.5.0/ccc-gistemp-0.5.0/tool/fetch.py”, line 348, in fetch_from_tar
tar = tarfile.open(”, mode=’r|%s’ % compression_type, fileobj=inp)
File “/usr/lib/python2.5/tarfile.py”, line 1046, in open
_Stream(name, filemode, comptype, fileobj, bufsize))
File “/usr/lib/python2.5/tarfile.py”, line 352, in __init__
self._init_read_gz()
File “/usr/lib/python2.5/tarfile.py”, line 439, in _init_read_gz
raise ReadError(“not a gzip file”)
tarfile.ReadError: not a gzip file
kampmann@ibk-node14:~/Projekte/GlobalWarming/ccc-giss 0.5.0/ccc-gistemp-0.5.0>

could you explain or help?
Thanks
Jörg

]]> By: Nick.Barnes http://clearclimatecode.org/code/comment-page-1/#comment-2233 Nick.Barnes Sat, 01 May 2010 11:15:51 +0000 http://clearclimatecode.org/?page_id=99#comment-2233 @Steven: We fetch the GISTEMP sources from http://data.giss.nasa.gov/gistemp/sources/GISTEMP_sources.tar.gz Because that is the link given on the relevant web page: http://data.giss.nasa.gov/gistemp/sources/ When we unpack this tarball, it used to make a directory called GISTEMP_sources. Now it makes a directory called GISTEMP_sources_open. Our preflight.py/fetch.py code is now independent of the name of this directory. We've never used the GISS_Obs_analysis link. @Steven: We fetch the GISTEMP sources from

http://data.giss.nasa.gov/gistemp/sources/GISTEMP_sources.tar.gz

Because that is the link given on the relevant web page:

http://data.giss.nasa.gov/gistemp/sources/

When we unpack this tarball, it used to make a directory called GISTEMP_sources. Now it makes a directory called GISTEMP_sources_open. Our preflight.py/fetch.py code is now independent of the name of this directory.

We’ve never used the GISS_Obs_analysis link.

]]> By: Steven mosher http://clearclimatecode.org/code/comment-page-1/#comment-2232 Steven mosher Fri, 30 Apr 2010 22:31:42 +0000 http://clearclimatecode.org/?page_id=99#comment-2232 hmm. We fetch various files such as station metadata from the GISTEMP source archive. The top-level directory in this archive has changed name from GISTEMP_sources to GISTEMP_sources_open. Our preflight code fails as a result. We should be flexible about this: for instance, by using a regular expression to match either old or new directory names. Is that URL correct? ftp://data.giss.nasa.gov/pub/gistemp/GISS_Obs_analysis/ Exists. ftp://data.giss.nasa.gov/pub/gistemp/GISS_Obs_analysis/GISTEMP_sources/ Exists. GISTEMP_sources_open doesnt exist hmm.

We fetch various files such as station metadata from the GISTEMP source
archive. The top-level directory in this archive has changed name from
GISTEMP_sources to GISTEMP_sources_open. Our preflight code fails as a
result. We should be flexible about this: for instance, by using a regular
expression to match either old or new directory names.

Is that URL correct?

ftp://data.giss.nasa.gov/pub/gistemp/GISS_Obs_analysis/

Exists.

ftp://data.giss.nasa.gov/pub/gistemp/GISS_Obs_analysis/GISTEMP_sources/

Exists.

GISTEMP_sources_open doesnt exist

]]> By: steven mosher http://clearclimatecode.org/code/comment-page-1/#comment-2216 steven mosher Sun, 25 Apr 2010 15:43:23 +0000 http://clearclimatecode.org/?page_id=99#comment-2216 Cool, l have the 0.4.1. so I just got the files from one of the tar on your dowloands ( gisstemp test ) hit enter. went to bed and woke up to a successful run. about 2100 seconds on a MAC lap top. All the work files look to be in order. nice work. I'll check out your comment above. Cool, l have the 0.4.1. so I just got the files from one of the tar on your dowloands ( gisstemp test ) hit enter. went to bed and woke up to a successful run. about 2100 seconds on a MAC lap top. All the work files look to be in order. nice work. I’ll check out your comment above.

]]> By: Nick.Barnes http://clearclimatecode.org/code/comment-page-1/#comment-2215 Nick.Barnes Sun, 25 Apr 2010 11:38:58 +0000 http://clearclimatecode.org/?page_id=99#comment-2215 @Steven: Yes, it changed a couple of weeks ago; I fixed our trunk sources to work either way. See <a href="http://code.google.com/p/ccc-gistemp/issues/detail?id=65" rel="nofollow">issue 65</a> and <a href="http://code.google.com/p/ccc-gistemp/source/detail?r=436" rel="nofollow">r436</a>. @Steven: Yes, it changed a couple of weeks ago; I fixed our trunk sources to work either way. See issue 65 and r436.

]]> By: steven mosher http://clearclimatecode.org/code/comment-page-1/#comment-2214 steven mosher Sun, 25 Apr 2010 07:35:39 +0000 http://clearclimatecode.org/?page_id=99#comment-2214 hmm. did giss change names? MISSING: input/ushcnV2_cmb.tbl MISSING: input/mcdw.tbl MISSING: input/ushcn2.tbl MISSING: input/sumofday.tbl MISSING: input/v2.inv MISSING: input/oisstv2_mod4.clim.gz PROBLEM: Tried fetching missing files but it didn't work. ====> STEPS 0 to 5 ==== Traceback (most recent call last): File "tool/run.py", line 225, in sys.exit(main()) File "tool/run.py", line 206, in main data = step_fn[step](data) File "tool/run.py", line 56, in run_step0 data = giss_io.step0_input() File "/Users/mosher/Downloads/ccc-gistemp-0.4.1/tool/giss_io.py", line 674, in step0_input input.ushcn_stations = read_USHCN_stations('input/ushcn2.tbl', 'input/ushcnV2_cmb.tbl') File "/Users/mosher/Downloads/ccc-gistemp-0.4.1/tool/giss_io.py", line 609, in read_USHCN_stations for line in open(ushcn_v1_station_path): IOError: [Errno 2] No such file or directory: 'input/ushcn2.tbl' hmm. did giss change names?

MISSING: input/ushcnV2_cmb.tbl
MISSING: input/mcdw.tbl
MISSING: input/ushcn2.tbl
MISSING: input/sumofday.tbl
MISSING: input/v2.inv
MISSING: input/oisstv2_mod4.clim.gz
PROBLEM: Tried fetching missing files but it didn’t work.
====> STEPS 0 to 5 ====
Traceback (most recent call last):
File “tool/run.py”, line 225, in
sys.exit(main())
File “tool/run.py”, line 206, in main
data = step_fn[step](data)
File “tool/run.py”, line 56, in run_step0
data = giss_io.step0_input()
File “/Users/mosher/Downloads/ccc-gistemp-0.4.1/tool/giss_io.py”, line 674, in step0_input
input.ushcn_stations = read_USHCN_stations(‘input/ushcn2.tbl’, ‘input/ushcnV2_cmb.tbl’)
File “/Users/mosher/Downloads/ccc-gistemp-0.4.1/tool/giss_io.py”, line 609, in read_USHCN_stations
for line in open(ushcn_v1_station_path):
IOError: [Errno 2] No such file or directory: ‘input/ushcn2.tbl’

]]> By: steven mosher http://clearclimatecode.org/code/comment-page-1/#comment-974 steven mosher Fri, 02 Apr 2010 17:31:49 +0000 http://clearclimatecode.org/?page_id=99#comment-974 Understood nick, It struck me as notes one would write to oneself when deep into coding where you live and breath the code like it was your native tongue. But it was helpful to me to just get my feet back under me WRT gisstemp code. Part of this is I'm putting together a bunch of metadata for any one to use, so I'm painfully aware that I better get all the ids correct etc so some of the id correction stuff was important, also learning R and trying to get the other data ( antartica ) into a GHCN format just as a R learning tool. Understood nick,

It struck me as notes one would write to oneself when deep into coding where you live and breath the code like it was your native tongue. But it was helpful to me to just get my feet back under me WRT gisstemp code.

Part of this is I’m putting together a bunch of metadata for any one to use, so I’m painfully aware that I better get all the ids correct etc
so some of the id correction stuff was important, also learning R and trying to get the other data ( antartica ) into a GHCN format just as a R learning tool.

]]> By: Nick.Barnes http://clearclimatecode.org/code/comment-page-1/#comment-964 Nick.Barnes Fri, 02 Apr 2010 10:33:58 +0000 http://clearclimatecode.org/?page_id=99#comment-964 Oh, OK. Yes, this should be documented better. Release 0.5.0 will do much better at documentation in general. But those -update-notes documents aren't gonig to be very helpful to anyone except an archaeologist. Oh, OK. Yes, this should be documented better. Release 0.5.0 will do much better at documentation in general. But those -update-notes documents aren’t gonig to be very helpful to anyone except an archaeologist.

]]>