Siphon - A collection of Python utilities for retrieving data from Unidata data technologies.
requests.exceptions.HTTPError: Error accessing http://thredds.ucar.edu/thredds/ncss/nws/metar/ncdecoded/Metar_Station_Data_fc.cdmr?var=weather&var=dew_point_temperature&var=inches_ALTIM&var=air_temperature&var=wind_from_direction&var=cloud_area_fraction&var=wind_speed&time=2018-06-11T15%3A17%3A59&west=-87.0&east=-89.0&south=40.5&north=42.7&accept=csv: 500 Infinite loop in linked list at recno= 23284
https://mesonet.agron.iastate.edu/sites/networks.php?network=RAOB&format=csv&nohtml=on
if so, you can do
pd.read_csv('https://mesonet.agron.iastate.edu/sites/networks.php?network=RAOB&format=csv&nohtml=on')
DATA_URL_FMT = (
'http://mesonet.agron.iastate.edu/'
'cgi-bin/request/daily.py?'
'network=IL_ASOS&stations={0}&'
'year1=2014&month1=1&day1=1&year2=2018&month2=1&day2=1'
)
STATIONS = ['ORD', 'DEC']
def to_df(station):
data_url = DATA_URL_FMT.format(station)
df = pd.read_csv(data_url, index_col=['station', 'day'], parse_dates=True)
df = df.apply(pd.to_numeric, errors='coerce')
return df
df = pd.concat(to_df(station) for station in STATIONS)
df['begints'] = df['begints'].str.replace('-5:50:36', '-06:00:00')
Hello! I'm not sure if this is the correct gitter to be posting this in, and I apologize if it isn't, but I've been unable to connect to the Unidata Thredds AWS radar server all day today. Here is a code snippet that I use and the error that I've been getting:
from siphon.catalog import TDSCatalog
from siphon.radarserver import RadarServer, get_radarserver_datasets
from datetime import datetime, timedelta
cat = TDSCatalog('http://thredds-aws.unidata.ucar.edu/thredds/radarServer/catalog.xml')
rs = RadarServer(cat.catalog_refs['S3 NEXRAD Level II'].href)
query = rs.query()
query.stations('KDOX').time(datetime.utcnow())
cat = rs.get_catalog(query)
raw_list = list(cat.catalog_refs)
ds = list(cat.datasets.values())[0]
"ConnectionError: HTTPConnectionPool(host='thredds-aws.unidata.ucar.edu', port=80): Max retries exceeded with url"
@dopplershift works now for python 3.5!...for 2.7, I receive this error message...
"HTTPError: 403 Client Error: Forbidden for url: http://thredds-aws.unidata.ucar.edu/thredds/radarServer/catalog.xml"
Hello!
I'm receiving a 'Connection Refused Error' due to Max entries exceeded. Last time it just required a reboot. Here's the error:
requests.exceptions.ConnectionError: HTTPConnectionPool(host='thredds-aws.unidata.ucar.edu', port=80): Max retries exceeded with url: /thredds/radarServer/nexrad/level2/S3/dataset.xml (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f24ce4c3748>: Failed to establish a new connection: [Errno 111] Connection refused',))
Hello!
I'm receiving an HTTPError when trying to pull Metar data via siphon from Unidata Thredds. The problem seems to be with my bounding box. When I try the bounding box from openradar , it works fine. However, when I try any other bounding box, I receive the error. Below is an example:
from netCDF4 import Datasetfrom siphon.ncss import NCSSfrom siphon.catalog import TDSCatalogfrom datetime import datetimemetar_cat_url = 'https://thredds.ucar.edu/thredds/catalog/nws/metar/ncdecoded/catalog.xml?dataset=nws/metar/ncdecoded/Metar_Station_Data_fc.cdmr'metar_cat = TDSCatalog(metar_cat_url)dataset = list(metar_cat.datasets.values())[0]ncss_url = dataset.access_urls["NetcdfSubset"]# bounding boxbb = {'north' : 47,
'south' : 42,
'east' : -88,
'west' : -100}
ncss = NCSS(ncss_url)ncss.variablesnow = datetime.utcnow()now_time = datetime(now.year, now.month, now.day, now.hour)
query = ncss.query()query.lonlat_box(north=bb['north'], south=bb['south'], east=bb['east'], west=bb['west'])query.time(now_time)query.variables('air_temperature', 'dew_point_temperature', 'inches_ALTIM',
'wind_speed', 'wind_from_direction', 'cloud_area_fraction', 'weather')query.accept('csv')
data = ncss.get_data(query)
And here is the error I receive:
HTTPError: Error accessing https://thredds.ucar.edu/thredds/ncss/nws/metar/ncdecoded/Metar_Station_Data_fc.cdmr?var=wind_from_direction&var=air_temperature&var=weather&var=dew_point_temperature&var=cloud_area_fraction&var=inches_ALTIM&var=wind_speed&time=2018-10-24T14%3A00%3A00&west=-100&south=42&north=47&east=-88&accept=csv: 500 Infinite loop in linked list at recno= 7976
Does anyone know a solution for this? Thanks!
