Siphon - A collection of Python utilities for retrieving data from Unidata data technologies.
requests.exceptions.HTTPError: Error accessing http://thredds.ucar.edu/thredds/ncss/nws/metar/ncdecoded/Metar_Station_Data_fc.cdmr?var=weather&var=dew_point_temperature&var=inches_ALTIM&var=air_temperature&var=wind_from_direction&var=cloud_area_fraction&var=wind_speed&time=2018-06-11T15%3A17%3A59&west=-87.0&east=-89.0&south=40.5&north=42.7&accept=csv: 500 Infinite loop in linked list at recno= 23284
https://mesonet.agron.iastate.edu/sites/networks.php?network=RAOB&format=csv&nohtml=on
if so, you can do
pd.read_csv('https://mesonet.agron.iastate.edu/sites/networks.php?network=RAOB&format=csv&nohtml=on')
DATA_URL_FMT = (
'http://mesonet.agron.iastate.edu/'
'cgi-bin/request/daily.py?'
'network=IL_ASOS&stations={0}&'
'year1=2014&month1=1&day1=1&year2=2018&month2=1&day2=1'
)
STATIONS = ['ORD', 'DEC']
def to_df(station):
data_url = DATA_URL_FMT.format(station)
df = pd.read_csv(data_url, index_col=['station', 'day'], parse_dates=True)
df = df.apply(pd.to_numeric, errors='coerce')
return df
df = pd.concat(to_df(station) for station in STATIONS)
df['begints'] = df['begints'].str.replace('-5:50:36', '-06:00:00')
Hello! I'm not sure if this is the correct gitter to be posting this in, and I apologize if it isn't, but I've been unable to connect to the Unidata Thredds AWS radar server all day today. Here is a code snippet that I use and the error that I've been getting:
from siphon.catalog import TDSCatalog
from siphon.radarserver import RadarServer, get_radarserver_datasets
from datetime import datetime, timedelta
cat = TDSCatalog('http://thredds-aws.unidata.ucar.edu/thredds/radarServer/catalog.xml')
rs = RadarServer(cat.catalog_refs['S3 NEXRAD Level II'].href)
query = rs.query()
query.stations('KDOX').time(datetime.utcnow())
cat = rs.get_catalog(query)
raw_list = list(cat.catalog_refs)
ds = list(cat.datasets.values())[0]
"ConnectionError: HTTPConnectionPool(host='thredds-aws.unidata.ucar.edu', port=80): Max retries exceeded with url"
@dopplershift works now for python 3.5!...for 2.7, I receive this error message...
"HTTPError: 403 Client Error: Forbidden for url: http://thredds-aws.unidata.ucar.edu/thredds/radarServer/catalog.xml"
Hello!
I'm receiving a 'Connection Refused Error' due to Max entries exceeded. Last time it just required a reboot. Here's the error:
requests.exceptions.ConnectionError: HTTPConnectionPool(host='thredds-aws.unidata.ucar.edu', port=80): Max retries exceeded with url: /thredds/radarServer/nexrad/level2/S3/dataset.xml (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f24ce4c3748>: Failed to establish a new connection: [Errno 111] Connection refused',))
Hello!
I'm receiving an HTTPError when trying to pull Metar data via siphon from Unidata Thredds. The problem seems to be with my bounding box. When I try the bounding box from openradar , it works fine. However, when I try any other bounding box, I receive the error. Below is an example:
from netCDF4 import Datasetfrom siphon.ncss import NCSSfrom siphon.catalog import TDSCatalogfrom datetime import datetimemetar_cat_url = 'https://thredds.ucar.edu/thredds/catalog/nws/metar/ncdecoded/catalog.xml?dataset=nws/metar/ncdecoded/Metar_Station_Data_fc.cdmr'metar_cat = TDSCatalog(metar_cat_url)dataset = list(metar_cat.datasets.values())[0]ncss_url = dataset.access_urls["NetcdfSubset"]# bounding boxbb = {'north' : 47,
'south' : 42,
'east' : -88,
'west' : -100}
ncss = NCSS(ncss_url)ncss.variablesnow = datetime.utcnow()now_time = datetime(now.year, now.month, now.day, now.hour)
query = ncss.query()query.lonlat_box(north=bb['north'], south=bb['south'], east=bb['east'], west=bb['west'])query.time(now_time)query.variables('air_temperature', 'dew_point_temperature', 'inches_ALTIM',
'wind_speed', 'wind_from_direction', 'cloud_area_fraction', 'weather')query.accept('csv')
data = ncss.get_data(query)
And here is the error I receive:
HTTPError: Error accessing https://thredds.ucar.edu/thredds/ncss/nws/metar/ncdecoded/Metar_Station_Data_fc.cdmr?var=wind_from_direction&var=air_temperature&var=weather&var=dew_point_temperature&var=cloud_area_fraction&var=inches_ALTIM&var=wind_speed&time=2018-10-24T14%3A00%3A00&west=-100&south=42&north=47&east=-88&accept=csv: 500 Infinite loop in linked list at recno= 7976
Does anyone know a solution for this? Thanks!
Hello!
I've been unable to pull radar data via Siphon since 6PM last night. It seems there's an error with the AWS credentials.
line 161, in get_catalog
raise BadQueryError(self.get_catalog_raw(query))siphon.http_util.BadQueryError: b'com.amazonaws.AmazonClientException: Unable to load AWS credentials from any provider in the chain