Best ChatGPT prompts for Statisticians

Given a dataset of customer purchase history with variables including age, income, purchase amount, and location, develop a step-by-step methodology to validate the assumptions of a linear regression model, including checks for linearity, homoscedasticity, and independence of residuals. Provide a Python script using scikit-learn and statsmodels to implement the validation process and interpret the results. Assume the data is stored in a Snowflake database and provide the necessary SQL query to extract the relevant data.

Design a workflow to assess the quality of a new dataset containing sensor readings from industrial equipment, using metrics such as completeness, accuracy, and consistency. Develop a data cleaning script in R to handle missing values, outliers, and invalid data points. Provide a statistical summary of the dataset before and after cleaning, including measures of central tendency and variability. Assume the data is stored in a CSV file and provide the necessary code to import and manipulate the data.

Given a Tableau dashboard displaying sales trends over time, develop an optimized SQL query to extract the necessary data from a large database, minimizing query execution time and reducing the load on the database server. Use techniques such as indexing, caching, and data aggregation to improve performance. Provide a step-by-step guide to implementing the optimized query, including the creation of relevant indexes and the configuration of the Tableau data connection.

Design an ETL (Extract, Transform, Load) pipeline to integrate data from multiple sources, including customer demographics, sales transactions, and market research. Develop a Python script using pandas and NumPy to extract data from CSV files, transform the data into a standardized format, and load it into a Snowflake database. Provide a detailed workflow diagram and a step-by-step guide to implementing the pipeline, including error handling and data validation. Assume the data sources are subject to change and provide a mechanism for adapting the pipeline to new data sources.