Using Spark RDD, we collect streaming JSON data with Kakfa from a source topic, read it as a Pandas dataframe and publish into a sink topic.
Using Spark DataFrames, we collect streaming JSON data with Kakfa from a source topic, read it as a Pandas dataframe and publish into a sink topic.