pyspark.sql.streaming.StreamingQueryManager.active

property StreamingQueryManager.active

Returns a list of active queries associated with this SQLContext

New in version 2.0.0.

Examples

>>> sq = sdf.writeStream.format('memory').queryName('this_query').start()
>>> sqm = spark.streams
>>> # get the list of active streaming queries
>>> [q.name for q in sqm.active]
['this_query']
>>> sq.stop()

pyspark.sql.streaming.StreamingQuery.stop pyspark.sql.streaming.StreamingQueryManager.awaitAnyTermination