MCQs

Disclaimer:

Educational Use Only:

The website links provided are to be used strictly for educational and knowledge-gaining purposes only.

No Misuse:

Do not misuse the links or the information contained therein for any commercial, illegal, or unethical activities.

Respect for Websites and Businesses:

Respect the intellectual property and business interests of the websites and their owners. Do not attempt to alter, copy, or redistribute content without proper authorization.

Acknowledge Value of Knowledge:

Recognize and value the knowledge and resources shared by these websites. Use the information responsibly and ethically.

No Endorsement:

The provision of these links does not imply endorsement of the linked sites, their content, or their products and services. Users are responsible for evaluating the suitability and accuracy of the information.

User Responsibility:

By accessing these links, you agree to use the information at your own risk and to comply with all applicable laws and website terms of use.

Overall MCQs for Reference

PySpark is an API for using Spark in which language?
a. Java
b. Scala
c. R
d. Python
Answer: d. Pythonincludehelp
PySpark supports which type of data processing?
a. Only batch
b. Only stream
c. Both batch and stream
d. Only real-time
Answer: c. Both batch and streamfreshersnow
Which library provides scalable machine learning in PySpark?
a. MLlib
b. NumPy
c. TensorFlow
d. Pandas
Answer: a. MLlibdatacamp
What is the main advantage of PySpark for Big Data?
a. Single-threaded processing
b. Distributed computing
c. Manual memory management
d. No SQL support
Answer: b. Distributed computingfreshersnow
Which of the following is a core data structure in PySpark?
a. DataFrame
b. List
c. Tuple
d. Set
Answer: a. DataFramedatacamp
Which function is used to read a DataFrame from a CSV file in PySpark?
a. read_csv()
b. spark.read.csv()
c. load_csv()
d. pd.read_csv()
Answer: b. spark.read.csv()k21academy
What does the PySpark transformation ‘filter’ return?
a. Filtered RDD
b. Aggregated RDD
c. Joined RDD
d. Sorted RDD
Answer: a. Filtered RDDscribd
Which PySpark method creates a new RDD from an existing one by changing each element?
a. map()
b. reduce()
c. join()
d. count()
Answer: a. map()includehelp
What is the default partitioning of a DataFrame in PySpark?
a. 1
b. 100
c. 200
d. 10
Answer: c. 200k21academy
Which PySpark class is used to connect to a Spark cluster?
a. SparkContext
b. SparkSession
c. SparkConf
d. SparkLink
Answer: b. SparkSessionfreshersnow
What is MLlib used for in PySpark?
a. Visualization
b. Machine Learning
c. Networking
d. Debugging
Answer: b. Machine Learningdatacamp
Which method is used to show the contents of a DataFrame?
a. display()
b. show()
c. print()
d. describe()
Answer: b. show()includehelp
Which operation is categorically a “transformation” in PySpark?
a. filter
b. collect
c. saveAsTextFile
d. count
Answer: a. filterfreshersnow
What type of operation is ‘reduce’ in PySpark?
a. Action
b. Transformation
c. Aggregation
d. Partitioning
Answer: a. Actionscribd
PySpark SQL allows querying DataFrames with what syntax?
a. JavaScript
b. SQL
c. Python expressions
d. JSON
Answer: b. SQLdatacamp
Which of the following algorithms is available in MLlib?
a. Linear Regression
b. Decision Trees
c. K-Means
d. All of the above
Answer: d. All of the abovefreshersnow
The function ‘cache()’ in PySpark is used for
a. Disk storage
b. Job scheduling
c. In-memory optimization
d. Serialization
Answer: c. In-memory optimizationwayground
Which of the following converts RDD to DataFrame?
a. toDF()
b. asDataFrame()
c. dfConvert()
d. rddFrame()
Answer: a. toDF()k21academy
The command to submit a PySpark script to a cluster is
a. spark-submit
b. python submit
c. pyspark-run
d. spark-run
Answer: a. spark-submitinterviewbit
PySpark DataFrames support grouping operations using
a. groupBy
b. partitionBy
c. splitBy
d. joinBy
Answer: a. groupBydatacamp
Which is not a type of join in PySpark DataFrames?
a. leftOuter
b. rightOuter
c. inner
d. crossJoin
Answer: d. crossJoinincludehelp
Which PySpark ML algorithm is used for clustering?
a. K-Means
b. Logistic Regression
c. Random Forest
d. Naive Bayes
Answer: a. K-Meansfreshersnow
In PySpark, which file extensions can be sent to PYTHONPATH?
a. .txt
b. .pdf
c. .py
d. .docx
Answer: c. .pyincludehelp
What is SparkContext mainly used for?
a. Initiating Spark
b. Defining variables
c. Rendering charts
d. Logging results
Answer: a. Initiating Sparkk21academy
Which Spark component does PySpark use for streaming?
a. Spark Streaming
b. Spark SQL
c. MLlib
d. GraphX
Answer: a. Spark Streamingdatacamp
Which function is used to remove duplicate rows in PySpark DataFrame?
a. drop_duplicates()
b. dropDup()
c. dropDuplicates()
d. removeDuplicates()
Answer: c. dropDuplicates()k21academy
In PySpark MLlib, which step is commonly used for feature selection?
a. VectorAssembler
b. Reduction
c. Filter
d. Split
Answer: a. VectorAssemblerdatacamp
Which PySpark method persists a DataFrame to RAM?
a. cache()
b. save()
c. persist()
d. store()
Answer: a. cache()wayground
PySpark can read which data formats natively?
a. CSV
b. Parquet
c. JSON
d. All of the above
Answer: d. All of the abovefreshersnow
PySpark Streaming processes live data using
a. DStreams
b. DataFrames
c. RDDs
d. Series
Answer: a. DStreamsdatacamp
In PySpark, the ‘collect()’ method is used to
a. Gather data in a list
b. Visualize data
c. Partition data
d. Clean data
Answer: a. Gather data in a listincludehelp
What is used in PySpark to join two DataFrames?
a. merge()
b. join()
c. connect()
d. combine()
Answer: b. join()freshersnow
Which PySpark MLlib function is used for regression algorithms?
a. LinearRegression
b. LogisticRegression
c. KMeans
d. TreeRegression
Answer: a. LinearRegressiondatacamp
What is the output of ‘count()’ in PySpark RDD?
a. Total number of elements
b. Average value
c. Maximum value
d. Minimum value
Answer: a. Total number of elementsscribd
The default mode of operation in PySpark DataFrame is
a. Lazy evaluation
b. Eager loading
c. Direct computation
d. Pre-fetching
Answer: a. Lazy evaluationk21academy
How are null values dropped from a PySpark DataFrame?
a. drop()
b. dropNulls()
c. dropna()
d. removeNulls()
Answer: c. dropna()includehelp
PySpark supports distributed machine learning on
a. Hadoop clusters
b. Kubernetes
c. YARN
d. All of the above
Answer: d. All of the abovedatacamp
Which technique is used to optimize PySpark job execution?
a. Caching
b. Shuffling
c. Partitioning
d. All of the above
Answer: d. All of the abovek21academy
Which object tracks current session in PySpark?
a. SparkSession
b. SessionMaker
c. SparkContext
d. SparkJob
Answer: a. SparkSessionfreshersnow
Which type of algorithm in PySpark MLlib is used for classification?
a. Logistic Regression
b. K-Means
c. PCA
d. SVD
Answer: a. Logistic Regressiondatacamp
PySpark can visualize DataFrames using
a. matplotlib
b. Pyplot
c. spark-visualize
d. Does not support visualization natively
Answer: d. Does not support visualization nativelyk21academy
How does PySpark enable AI model deployment?
a. By exporting models
b. By integrating with Spark clusters for inference
c. By using REST APIs
d. By saving as PDFs
Answer: b. By integrating with Spark clusters for inferencedatacamp
Which PySpark command initiates MLlib algorithms?
a. ml.run()
b. spark.ml()
c. from pyspark.ml import …
d. spark.startML()
Answer: c. from pyspark.ml import …k21academy
How do you persist DataFrames in PySpark beyond RAM?
a. save()
b. persist(storageLevel=Disk)
c. storeToDisk()
d. diskPersist()
Answer: b. persist(storageLevel=Disk)includehelp
Spark’s in-memory processing makes PySpark best for
a. Real-time computation
b. Archival data
c. Batch-only jobs
d. Visualization
Answer: a. Real-time computationfreshersnow
Which function gets the path to working directory in PySpark?
a. SparkFiles.get
b. getDir()
c. jobDir.get
d. wd.get()
Answer: a. SparkFiles.getincludehelp
PySpark SQL supports
a. Hive
b. JDBC
c. Avro
d. All of the above
Answer: d. All of the abovefreshersnow
Which parameter sets number of partitions in PySpark DataFrame?
a. numPartitions
b. setPartition
c. repartition
d. partitionCount
Answer: c. repartitiondatacamp
Which is used to upload files with jobs in PySpark?
a. sc.addFile
b. spark.uploadFile
c. job.add()
d. uploadToCluster
Answer: a. sc.addFileincludehelp
What does sc.parallelize() do in PySpark?
a. Creates RDD from a Python collection
b. Starts the Spark job
c. Connects to cluster
d. Saves result to disk
Answer: a. Creates RDD from a Python collectionk21academy

Blog

Systemethic Technologies

Leave a Reply Cancel reply

Useful links

Other Terms & Policies

Contact Info