Startseite Erkunden Hilfe
Registrieren Anmelden
temp
/
openaq_ingestion
2
0
Fork 0
Dateien Issues 0 Pull-Requests 0 Wiki

A small package to ingest a OpenAQ SQS queue.

Branch: master
Branches Tags
openaq_ingestio...
ZIP TAR.GZ
Aurelien 039686bb22 Initial commit of openaq_ingestion. A small package to ingest a vor 6 Jahren
openaq_ingestion 039686bb22 Initial commit of openaq_ingestion. A small package to ingest a vor 6 Jahren
.gitignore 039686bb22 Initial commit of openaq_ingestion. A small package to ingest a vor 6 Jahren
README.md 039686bb22 Initial commit of openaq_ingestion. A small package to ingest a vor 6 Jahren
requirements.txt 039686bb22 Initial commit of openaq_ingestion. A small package to ingest a vor 6 Jahren
settings.example.yaml 039686bb22 Initial commit of openaq_ingestion. A small package to ingest a vor 6 Jahren
setup.py 039686bb22 Initial commit of openaq_ingestion. A small package to ingest a vor 6 Jahren
test.py 039686bb22 Initial commit of openaq_ingestion. A small package to ingest a vor 6 Jahren

README.md

Package to help import the openaq SQS queue in RDS.

Configuration

Copy settings.example.yaml to settings.yaml and set a valid database uri for storage. Set up AWS credentials in ~/.aws/ by using for example aws configure (if you have the AWS CLI installed). This package expects an SQS queue named openaq in the eu-west-1 region.

Usage

Two tooling entry points are defined:

  • initdb: initialize the database with the required table for openaq measurements.

  • processqueue: a utility to ingest the messages of the openaq queue:

    Usage: processqueue [OPTIONS]

    Options: --amount INTEGER Amount of messages to fetch. --delete BOOLEAN Delete messages from the queue after successful storage. --help Show this message and exit.