Skip to content

Commit f11fee3

Browse files
authored
Update readme
1 parent 8fdb572 commit f11fee3

File tree

1 file changed

+33
-34
lines changed

1 file changed

+33
-34
lines changed

README.md

+33-34
Original file line numberDiff line numberDiff line change
@@ -15,14 +15,14 @@
1515
- [Setting up PostgreSQL storage](#setting-up-postgresql-storage)
1616
- [Setting up Cloud Spanner](#setting-up-cloud-spanner)
1717
- [Setting up importers](#setting-up-importers)
18-
- [TarGz](#targz)
19-
- [Deb](#deb)
20-
- [RPM](#rpm)
21-
- [Zip (and other zip-like formats)](#zip-and-other-zip-like-formats)
2218
- [GCP (Google Cloud Platform)](#gcp-google-cloud-platform)
2319
- [GCR (Google Container Registry)](#gcr-google-container-registry)
2420
- [Windows](#windows)
2521
- [WSUS](#wsus)
22+
- [TarGz](#targz)
23+
- [Deb](#deb)
24+
- [RPM](#rpm)
25+
- [Zip (and other zip-like formats)](#zip-and-other-zip-like-formats)
2626
- [Setting up exporters](#setting-up-exporters)
2727
- [Setting up Postgres exporter](#setting-up-postgres-exporter)
2828
- [Setting up GCP exporter](#setting-up-gcp-exporter)
@@ -195,36 +195,7 @@ In order to use Cloud Spanner to store information about processing tasks you ne
195195

196196
### Setting up importers
197197

198-
In order to specify which importer you want to run you should use the `-importers` flag. Possible values: `GCP,targz,windows,wsus`
199-
200-
201-
#### TarGz
202-
203-
This is a simple importer that traverses repositories and looks for `.tar.gz` files. Once found it will hash the first and the last 10MB of the file to check if it was already processed. This is done to prevent hashing the whole file every time the repository is scanned for new sources. To use this importer you need to specify the following flag(s):
204-
205-
1. `-targz_repo_path` which should point to the path on the local file system that contains `.tar.gz` files
206-
207-
#### Deb
208-
209-
This is very similar to the TarGz importer except that it looks for `.deb` packages. Once found it will hash the first and the last 10MB of the file to check if it was already processed. This is done to prevent hashing the whole file every time the repository is scanned for new sources. To use this importer you need to specify the following flag(s):
210-
211-
1. `-deb_repo_path` which should point to the path on the local file system that contains `.deb` files
212-
213-
#### RPM
214-
215-
This is very similar to the TarGz importer except that it looks for `.rpm` packages. Once found it will hash the first and the last 10MB of the file to check if it was already processed. This is done to prevent hashing the whole file every time the repository is scanned for new sources. To use this importer you need to specify the following flag(s):
216-
217-
1. `-rpm_repo_path` which should point to the path on the local file system that contains `.rpm` files
218-
219-
#### Zip (and other zip-like formats)
220-
221-
This is very similar to the TarGz importer except that it looks for `.zip` archives. Once found it will hash the first and the last 10MB of the file to check if it was already processed. This is done to prevent hashing the whole file every time the repository is scanned for new sources. To use this importer you need to specify the following flag(s):
222-
223-
1. `-zip_repo_path` which should point to the path on the local file system that contains `.zip` files
224-
225-
Optionally, you can also set the following flag(s):
226-
227-
1. `-zip_file_exts` comma-separated list of file extensions to treat as zip files, eg. "zip,whl,jar". Default: "zip"
198+
In order to specify which importer you want to run you should use the `-importers` flag. Possible values: `GCP,targz,windows,wsus,deb,rpm,zip,gcr`
228199

229200
#### GCP (Google Cloud Platform)
230201

@@ -415,6 +386,34 @@ gsutil -m rsync -r D:/WSUS/WsusContent gs://hashr-wsus/
415386

416387
This will dump the relevant information from WSUS DB, store it in the `export.csv` file and sync the contents of the WSUS folder with GCS bucket. WSUS importer will check if `export.csv` file is present in the root of the WSUS repo, if so it will use it.
417388

389+
#### TarGz
390+
391+
This is a simple importer that traverses repositories and looks for `.tar.gz` files. Once found it will hash the first and the last 10MB of the file to check if it was already processed. This is done to prevent hashing the whole file every time the repository is scanned for new sources. To use this importer you need to specify the following flag(s):
392+
393+
1. `-targz_repo_path` which should point to the path on the local file system that contains `.tar.gz` files
394+
395+
#### Deb
396+
397+
This is very similar to the TarGz importer except that it looks for `.deb` packages. Once found it will hash the first and the last 10MB of the file to check if it was already processed. This is done to prevent hashing the whole file every time the repository is scanned for new sources. To use this importer you need to specify the following flag(s):
398+
399+
1. `-deb_repo_path` which should point to the path on the local file system that contains `.deb` files
400+
401+
#### RPM
402+
403+
This is very similar to the TarGz importer except that it looks for `.rpm` packages. Once found it will hash the first and the last 10MB of the file to check if it was already processed. This is done to prevent hashing the whole file every time the repository is scanned for new sources. To use this importer you need to specify the following flag(s):
404+
405+
1. `-rpm_repo_path` which should point to the path on the local file system that contains `.rpm` files
406+
407+
#### Zip (and other zip-like formats)
408+
409+
This is very similar to the TarGz importer except that it looks for `.zip` archives. Once found it will hash the first and the last 10MB of the file to check if it was already processed. This is done to prevent hashing the whole file every time the repository is scanned for new sources. To use this importer you need to specify the following flag(s):
410+
411+
1. `-zip_repo_path` which should point to the path on the local file system that contains `.zip` files
412+
413+
Optionally, you can also set the following flag(s):
414+
415+
1. `-zip_file_exts` comma-separated list of file extensions to treat as zip files, eg. "zip,whl,jar". Default: "zip"
416+
418417
### Setting up exporters
419418

420419
#### Setting up Postgres exporter

0 commit comments

Comments
 (0)