Sollicitatievraag bij Frontline Performance Group

PySpark: What is PySpark? PySpark is the Python API for Apache Spark. Explain its significance in big data processing. Differentiate between DataFrame and RDD in PySpark. Discuss the characteristics and use cases of DataFrame and Resilient Distributed Dataset (RDD). How does lazy evaluation work in PySpark? Explain the concept of lazy evaluation and how it benefits the performance of PySpark jobs. What is a Transformer in PySpark? Provide examples of Transformers in PySpark and their role in machine learning pipelines. Apache Hadoop: Explain the core components of Apache Hadoop. Discuss Hadoop Distributed File System (HDFS), MapReduce, and YARN. What is the role of the ResourceManager in Hadoop YARN? Describe the responsibilities of the ResourceManager in a Hadoop cluster. Differentiate between Hadoop and Apache Spark. Compare and contrast the key features and use cases of Hadoop and Apache Spark. Python Code: Write a Python code snippet to read a CSV file using Pandas. Demonstrate how to import Pandas and read a CSV file into a DataFrame. Explain the concept of list comprehensions in Python. Provide an example of a list comprehension and explain its advantages. How do you handle exceptions in Python? Discuss the try-except block and how it is used to handle exceptions in Python. Write a Python function to calculate the factorial of a number. Provide a Python function that calculates the factorial of a given integer. These questions cover a range of topics related to PySpark, Apache Hadoop, and Python coding skills. Depending on the specific job role, the interviewer may tailor the questions to assess the candidate's expertise in these areas.