Skip to content

Latest commit

 

History

History
17 lines (14 loc) · 517 Bytes

README.md

File metadata and controls

17 lines (14 loc) · 517 Bytes

spark_bigquery

Big query connector for spark

Setup instructions:

  • Install docker
  • Run setup.sh

Manual Setup:

  • Run below commands in order:
    1. eval $(docker-machine env default)
    2. docker pull aniryou/spark_bigquery
    3. docker run -ti -p 8888:8888 -v <path_to_repo>:/mnt --name spark_bq aniryou/spark_bigquery

Playing with code: 4. docker-machine env default + use DOCKER_HOST ip address to access jupyter notebook on http://DOCKER_HOST:8888 5. upload Iris and Wordcount notebooks and run same