summaryrefslogtreecommitdiff
path: root/README.md
diff options
context:
space:
mode:
authorshprdchris <shprd.chris@gmail.com>2022-02-01 12:38:10 +0000
committershprdchris <shprd.chris@gmail.com>2022-02-02 11:54:33 +0000
commit73778599055582a974fad5f8747b98ee5de45da6 (patch)
tree766bf8a445adf836334c51d4f99a5ef2c5fda0d7 /README.md
parent696022f762d4e51920ea4a937386d93e971aca4f (diff)
downloadlorry-73778599055582a974fad5f8747b98ee5de45da6.tar.gz
(v2) Make raw importer honour multiple files
Resolves issue where raw importer was only honouring last entry for several files with same upstream path. These files were being passed as comma-separated URLs under the 'urls' tag in the .lorry file. The yaml importer could only store one entry per 'urls', updating a dictionary entry after each comma. The changes in this commit allow for multiple files to be added, but the URLs must now be added in the form: ``` urls: - destination: libosinfo url: https://releases.pagure.org/libosinfo/osinfo-db-20211216.tar.xz - destination: libosinfo url: https://releases.pagure.org/libosinfo/libosinfo-1.2.0.tar.gz ``` A previous branch was created to resolve this issue, but the solution required URLs to be separted by whitespace. It was decided that the format implemented here is preferable. Resolves: #29
Diffstat (limited to 'README.md')
-rw-r--r--README.md14
1 files changed, 10 insertions, 4 deletions
diff --git a/README.md b/README.md
index 199e8da..302b443 100644
--- a/README.md
+++ b/README.md
@@ -297,10 +297,16 @@ repository.
{
"raw-file-repo": {
"type": "raw-file",
- "urls": {
- "authorities/england-and-wales": "http://geoportal1-ons.opendata.arcgis.com/datasets/0b09996863af4b5db78058225bac5d1b_0.kml",
- "radiological-monitoring-data": "https://fsadata.github.io/radiological-monitoring-data/data/provisional-2016-bi-annual-aquatic-and-terrestrial-monitoring-results-26062017-raw-results.csv"
- }
+ "urls": [
+ {
+ "url": "http://geoportal1-ons.opendata.arcgis.com/datasets/0b09996863af4b5db78058225bac5d1b_0.kml",
+ "destination": "authorities/england-and-wales"
+ },
+ {
+ "url": "https://fsadata.github.io/radiological-monitoring-data/data/provisional-2016-bi-annual-aquatic-and-terrestrial-monitoring-results-26062017-raw-results.csv",
+ "destination": "radiological-monitoring-data"
+ }
+ ]
}
}