Spark Lab1

 

Data files for the Labs is located here

Steps

  • Open a new notebook – with python
  • write a simple function in python to add 2 numbers and test it
  • upload the file tips.csv to /FileStore/tables
  • Create a spark data frame from the above file and display it
  • Create a table from the tips file in Databricks Data
  • using SQL statement select the tips that are less than 1 $