Sign inSign up

kai5263499/rhema-scrape

By kai5263499

Updated over 6 years ago

Image for scraping urls for content

Image
0

300

kai5263499/rhema-scrape repository overview

rhema

rhema is the Greek word for "utterance" or "thing said". This project is all about taking the content of a URI and turning it into compressed audio for faster (for me anyway) consumption.

Building

Developing on this project is as easy as:

# Set some env vars
export S3_BUCKET="my-s3-bucket"
export AWS_DEFAULT_REGION="aws-default-region"
export AWS_ACCESS_KEY_ID="aws-access-key"
export AWS_SECRET_ACCESS_KEY="aws-secret-access-key"
export LOCAL_DEV_PATH="/my/local/dev/path"
export LOCAL_CONTENT_PATH="/local/content/path"

# make the builder image
make builder-image

# execute the interactive development shell
make exec-interactive

Usage

Use the scrape image to test scraping a url of its content

docker run \
--rm \
kai5263499/rhema-scrape "${URI}"

Use the process-url image to process a URL into an mp3 stored in the ${LOCAL_PATH} directory

docker run \
--rm \
-e S3_BUCKET="${S3_BUCKET}" \
-e AWS_DEFAULT_REGION="${AWS_DEFAULT_REGION}" \
-e AWS_ACCESS_KEY_ID="${AWS_ACCESS_KEY_ID}" \
-e AWS_SECRET_ACCESS_KEY="${AWS_SECRET_ACCESS_KEY}" \
-v ${LOCAL_PATH}:/data \
--tmpfs /tmp \
kai5263499/rhema-process-url "${URI}"

Misc

There are a few other optional parameters that can be set.

WORDS_PER_MINUTE - How fast espeak should make its resulting speech

ATEMPO - How much to make audio and video content. This is a floating point decimal where the default is 2.0 or 2x the origional speed

Possible espeak-ng voice options for the optional ESPEAK_VOICE parameter include the following from /usr/lib/x86_64-linux-gnu/espeak-ng-data/voices/!v/:

 Andy          Gene    Mario         Tweaky   f1   f5      john         klatt3   m2   m6       norbert   steph    whisper
 Annie         Gene2   Michael       aunty    f2   iven    kaukovalta   klatt4   m3   m7       quincy    steph2   whisperf
 AnxiousAndy   Jacky  'Mr serious'   boris    f3   iven2   klatt        linda    m4   max      rob       steph3   zac
 Denis         Lee     Storm         croak    f4   iven3   klatt2       m1       m5   michel   robert    travis

Tag summary

Content type

Image

Digest

Size

8.5 MB

Last updated

over 6 years ago

docker pull kai5263499/rhema-scrape