代做INFS 5135 Assignment – Analysis of a dataset调试Python程序

INFS 5135

Assignment – Analysis of a dataset

Individual

1 Bibliography

1.1 Source 1

The New Profession of Business Analyst and the New Occupational Standards: The Case of Russia (Chernysheva, Y. garyevna, & Shepelenko, G. i., 2018) explains the current situation of the emerging profession of business analyst in Russia and the challenges it faces. By combining international experience and local needs, it introduces the standards of this profession and how to improve the application and value of business analysis in enterprises.

a) Read

This study focuses on the main concepts of business analysis in international and Russian practice and compares the differences between business analysis in Russian companies and more mature business analysis methods in the world.

b) Find

With globalization and technological progress, information and analysis have become the key to business success. Companies need to use analysis to identify problems, develop solutions, and predict future business development.

c) Evaluate

The results of the CRAAP test analysis of this paper are shown in Table 1.1.

Currency

The article was published in 2018. Considering the rapid development of the business analyst profession, the information in this article is still of certain reference value, but it may need to be supplemented with the latest data and research.

Relevance

The article is highly relevant to the study of the business analyst profession, especially in terms of how Russia has introduced and standardized this profession. The article is very valuable for those who study the Russian market or compare international standards.

Accuracy

The article uses a lot of literature and case analysis to support its views, especially the reference to BABOK enhances its academic nature. However, the article is mainly based on literature and case analysis, and may lack empirical data support for the latest practices.

Authority

The authors are professors from the Russian State University of Economics with a doctorate in economics. They have rich academic and practical experience in related fields. This provides strong support for the credibility of the article.

Purpose

The purpose of the article is to explore the international standardization of the business analyst profession and its application in Russia. The purpose is clear and it is of great significance both academically and practically. The article does not show any bias and the information is presented objectively.

Table 1.1: CRAAP Test of reference article 1

1.2 Source 2

The article "An Investigation of the Role of Business Analysts in IS Development" (Debra, P., & Yin, T. L.,  2015) mainly analyzes the role of business analysts in information systems projects and their contribution to project outcomes. This article focuses on understanding the role of business analysts, the skills they need, the techniques and methods they use, and how their work affects the success of information systems projects.

d) Read

A case study method was adopted, and data was collected through one-on-one conversations. The research subjects were senior business analysts with rich experience, each of whom had at least ten years of work experience. These experts were able to provide in-depth insights into the work of business analysts.

e) Find

The study found that business analysts firmly believe that they now play an important role in the company's information system. However, when they first started this job, they also faced problems such as mismatched skills and insufficient work experience that led to difficulties in applying for jobs.

f) Evaluate

The results of the CRAAP test analysis of this paper are shown in Table 1.2.

Currency

The article was published in 2015. Considering the rapid development of information technology and business analysis, it may be necessary to combine the latest research results to verify the validity of its conclusions.

Relevance

The article directly addresses the topic of the role of business analysts in the development of information systems, and introduces the career development process of business analysts in the company. The main content is highly relevant to my analysis direction.

Accuracy

The research method is rigorous, and the data is based on first-hand information from business analyst experts. Although the sample size is small, the data is still very serious and thorough.

Authority

The author is from the University of Reading in the UK and is an expert in this field. The article is published in the AIS Electronic Library, a respected information system academic resource platform.

Purpose

The purpose of the study is to fill the gap between the theory and practice of the business analyst position, enhance the understanding of business analysis work, so as to understand the skills, tools and other factors involved in this profession, and point out the direction for future research.

Table 1.2: CRAAP Test of reference article 2

2 Mind map of the problem

2.1 Problem

Through the above reference articles, I have a clearer understanding of the profession of business analyst.

What skills do you have, whether you have work experience, which companies need business analysts most, and what similar positions are there? These questions have aroused my curiosity. In order to better study these issues, I drew a mind map as shown in Figure 2.1.

2.2 Mind map

Figure 2: Relevant factors for business analysts

3 Data dictionary

3.1 Data introduction

To perform. data analysis on the mind map above, I used the "1.3M LinkedIn Jobs and Skills 2024" dataset from Kaggle. This dataset contains about 1.3 million job postings from LinkedIn, covering job opportunities in different regions and industries. The dataset consists of multiple CSV files, mainly including job postings on LinkedIn and job-related skill requirements.

3.2 List of columns

a) job_skills.csv:

job_link

job_skills

b) linkedin_job_postings.csv:

job_link

Company

Is Being Worked

Job Title

Search Position

4 Result of exploring the data

4.1 Which companies need business analysts the most?

Analysis steps

Data collection: I extracted job information related to "business analyst" from the data set, including job_title, company name, and skill information required for the position, and finally obtained 4440 records.

Data cleaning: I cleaned the job data, removed irrelevant columns.

Data aggregation and grouping: The cleaned data was grouped by company name, and the number of business analyst positions posted by each company was counted and displayed in descending order. Because there are too many company names in the results, for easy viewing, I filtered out companies with less than 30 business analysts.

Analysis purpose

The purpose of this is to understand which companies have the greatest demand for business analysts and how these demands are distributed among different companies. This helps job seekers understand market opportunities and helps companies and recruiters better understand the competitive situation in the industry.

Analysis results

As shown in Figure 4.1, LATICRETE International has the highest number of business analyst positions posted on LinkedIn, which is significantly higher than other companies. This shows that companies in this traditional industry rely heavily on data analysis and business insights.

Figure 4.1: Number of business analyst positions in companies

Think about the result

From the results, traditional companies, especially in the physical industry, have a high demand for business analysts, reflecting that these companies rely heavily on data-driven analysis in their decision-making process. This may also indicate that business analysts have good career prospects in these industries.

4.2 Essential skills for business analysts

Analysis steps

Data collection: I extracted job information related to "business analyst" from the data set, including job_title, company name, and skill information required for the position, and finally obtained 4440 records.

Data cleaning: I cleaned the job data, removed irrelevant columns, split the skill field, and separated each skill. For some similar skills caused by input problems, I used string replacement (such as: problem solving replaced problemsolving) to ensure the accuracy of the analysis results.

Data aggregation and grouping: The number of times each skill appeared in the recruitment of business analysts in different companies was counted to determine which skills are most commonly required for business analyst positions.

Analysis purpose

The purpose of this analysis is to understand which skills employers value most when recruiting business analysts and to explore the priority of these skills. This will help consulting companies understand the market demand for business analyst skills, and can also help identify key skills and provide reference for recruitment and training.

Analysis results

From the Figure 4.2, the skill requirements for business analyst positions are very diverse, requiring both technical skills and business and communication skills. This multi-dimensional skill demand reflects the multiple roles that business analysts play in enterprises - not only processing data, but also converting analysis results into actionable business recommendations.

Figure 4.2: Essential skills for business analysts

Think about the result

From the results, traditional companies, especially in the physical industry, have a high demand for business analysts, reflecting that these companies rely heavily on data-driven analysis in their decision-making process. This may also indicate that business analysts have good career prospects in these industries.

4.3 Job positions related to business analysts

Analysis steps

Data collection: I extracted job information related to "business analyst" from the data set, including job_title, company name, and skill information required for the position, and finally obtained 4440 records.

Data cleaning: I cleaned the job data, removed irrelevant columns.

Data aggregation and grouping: Group according to the value of search position and analyze which positions have a high number of "Business Analyst" when users search, so as to identify positions with strong relevance to Business Analyst.

Analysis purpose

The purpose of this analysis is to understand the degree of relevance of the profession of "business analyst" to other professions. By identifying which positions are most likely to have "business analysts", it can reveal the degree of cooperation or overlapping responsibilities between these positions and business analysts. This analysis helps companies understand the career paths related to business analysts and also helps companies identify opportunities for career cooperation.

Analysis results

As shown in Figure 4.3, "Business Analyst" is most likely to appear when users search for management analysis positions (with a probability of more than 25%), followed by Job Analyst, Quality Assurance Analyst and Consulting Education.

Figure 4.3: Positions most associated with business analyst

Think about the result

The results show that the job responsibilities of business analysts and management analysts are very similar. Both involve data analysis, problem identification, solution recommendations, etc., and their main goal is to help companies optimize decision-making and improve operational efficiency. There are other occupations such as Job Analyst, Quality Assurance Analyst and Consulting Education, which have a strong correlation with the work content of business analysts and may require regular cooperation or have similar skill requirements.

4.4 Skills required for management analysts

To prove the guess in 4.3, I processed and analyzed the source data set again to find the required skills for the management analyst profession.

Analysis steps

Data collection: Data collection: I extracted job information related to "management analyst" from the data set, including job_title, company name, and skill information required for the position, and finally obtained 898 records.

Data cleaning: I cleaned the job data, removed irrelevant columns, split the skill field, and separated each skill. For some skills that were similar due to input problems, I used string replacement (such as: problem solving replaced problem solving) to ensure the accuracy of the analysis results.

Data aggregation and grouping: Count the number of times each skill appears in the recruitment of management analysts in different companies to determine which skills are most commonly required for management analyst positions.

Analysis purpose

he purpose of this analysis is to understand which skills employers value most when recruiting management analysts and explore the similarity of these skills with business analysts. This proves that my analysis results in Section 4.3 are correct.

Analysis results

As can be seen from Figure 4.4, the top 5 skills most required for the management analyst position are the same as the top 5 skills most required for the business analyst, with only the order of the fourth and fifth skills being different.

Figure 4.4: Essential skills for management analysts

Think about the result

Business analysts and management analysts share the same core skills, which means there is a clear overlap in their responsibilities. Both need to process large amounts of data, conduct in-depth analysis, and transform. the results into insights that can guide business decisions.

5 Data quality analysis

5.1 Introduction

The dataset "1.3M LinkedIn Jobs and Skills 2024" contains about 1.3 million job postings from LinkedIn, covering recruitment data updated from January 12 to January 17, 2024. The following are some assessments on data quality (DQA), including completeness, consistency, accuracy, timeliness, validity, and uniqueness.

5.2 Completeness

The dataset contains multiple fields, such as job title, company name, location, last processed date, skill requirements, job type, etc. In the data I analyzed (Business Analyst and Management Analyst occupations), the data of all fields is complete, but due to the large amount of data, some records may have missing values or incomplete information, which will bring challenges to data analysis.

5.3 Consistency

Although the data are all captured from the same platform. (LinkedIn), some fields (such as job skills) may have inconsistent expressions due to the freedom of job posters. For example, some companies use business analytical, business analysis, and business analytics to represent business analysis skills, and the naming of skills may also contain abbreviations (such as ba). This needs to be standardized before analysis. I used the string replacement method in the Python code of data clean to solve this problem.

5.4 Accuracy

The accuracy of the data is generally high because it comes from a reliable professional social platform. However, the job title, job summary, and job skills are entered by the company itself, so there may be human errors or subjective descriptions. When analyzing, it is necessary to combine the needs of business analysts to reasonably screen and verify the data.

5.5 Timeliness

The job information in the dataset mainly covers the recruitment data on LinkedIn in January 2024. Although it has been more than half a year, it is still very timely and suitable for analyzing recruitment trends at the beginning of this year. However, since the company's recruitment information will be modified at any time, some data may be outdated, and the impact of time factors in analyzing business analysts needs to be considered.

5.6 Validity

While analyzing the most in-demand skills for business analysts, we found a lot of anomalies in the skill data, where some skills were abbreviated as BA, while others were written as business analysis, business analytics, and business analytical. Some skills were written as communication, while others were written as communicate. This confusing data raised questions about its validity in the context of our analysis.

As shown in Figure 5.1, I queried the number of occurrences of skills similar to business analysis in the data where job_title included business analyst.

Figure 5.1: Number of occurrences of business analysis-like skills

As can be seen from the above figure, more than a dozen business analysis-like skills appeared more than 5 times, and many less than 5 times were filtered out by me. In order to reduce the interference of these data on the analysis and ensure the integrity of the data and the availability of the analysis. I implemented the cleaning of the job_skill column in the business analyst data in Python code, as shown in Figure 5.2.

Figure 5.2: Job skill cleaning code

5.7 Uniqueness

There may be duplicate records in the data set, for example, the same position was captured multiple times, resulting in duplicate values in the job_link in the data set. In order to avoid these duplicate records causing deviations in the analysis process, I will use deduplication counting on job_link during the analysis process to ensure the uniqueness of the data and reduce the interference of duplicate data on the analysis results.

6 Summary

Through the analysis of LinkedIn job data, we can fully understand the distribution of the business analyst position in various companies, the key skills required for the position, and the related positions. And the data quality analysis further ensures the reliability of the analyzed data and analysis results. In the role of business analyst, the combination of technical and business capabilities is particularly important. The demand for these comprehensive skills by recruiting companies reflects their key position in the modern data-driven business environment. In the future, career development and corporate recruitment strategies can be planned and adjusted more targeted based on my analysis.

7 References

Chernysheva, Y. garyevna, & Shepelenko, G. i. (2018). The New Profession of “Business Analyst” and the New Occupational Standards : The Case of Russia. European Research Studies Journal, 21(1). https://www.um.edu.mt/library/oar/handle/123456789/33818

Debra, P., & Yin, T. L. (2015). An Investigation of the Role of Business Analysts in IS Development. ECIS 2015 Completed Research Papers, 142. http://aisel.aisnet.org/ecis2015_cr/142