Usage of Web Scraping in the Pharmaceutical Sector

INTRODUCTION: Web scraping is a technique that provides organizations with the ability to analyse large amounts of information and gather new information. OBJECTIVES: Find a group that is a health check, a full body test, a blood test, and so on. In this way, the pharmaceutical industry should consider how to improve information, information storage, information retrieval, and capture. For example, the healthcare system may decide to standardize the assessment of speech and allow information to be shared across organizations to improve treatment outcomes in web scraping applications. METHODS: Web scraping is based on the pharmaceutical industry. From here, we get information about pharmacies, such as drug names in different categories or drug sales. However, we are dealing with diseases and common medicines. Using this information, we can find the most common viruses. There are many factors to consider when creating a junk website for the pharmaceutical industry, such as drug names, tablet categories, and syrups found in the pharmaceutical industry. RESULTS: As is clearly visible from the output, there are columns for drug names, manufacturers, drug types, and prices. This is the information we get from a website called Net meds, a pharmacy site. With the help of this information, we learn which drugs are most needed, and then we can find the most common diseases today. CONCLUSION: The results of this web scraping can be very useful and powerful. However, the industry's success in web scraping and data extraction techniques depends on the availability of clean chemical data.


Introduction
Web scraping is a process where we get information from websites such as www.We get information from websites using this method, but sometimes it becomes illegal.So only that person uses the process to download the website with a license.Net scraping of presidential websites is illegal.We cannot web scrape government websites.Format, HTTP programming, HTML parsing, DOM parsing, etc.We have some data extraction methods such as We use web scraping to extract the data.We use web scraping to extract large amounts of information from websites into Excel files or databases.We all know that health is wealth, which means that health is very important to life.Last year also proved that Covid-19 is not the only disease of concern.India has also seen cases of scarlet fever, tomato flu, black fungus, and measles in cattle, as well as nodular skin disease.Thus, we can measure viruses with the help of web scraping.We extract information from the websites of online pharmaceutical companies so that we can understand the types of diseases in our country.Pharmaceutical companies store information about drugs in medical records.

Related Work
In an article called Web Scrapping published in 2017, author Bo Zhao [1]said the nice soup technique for web scraping is limited, according to this theory, if the web scraper sends too much request data, it serves as the equivalent of a denial of service.A 2012 article by Internet advertising writer Anand V. Saurkar, Kedar G. Pathare, and Shweta A Gode titled "Web Scraping Using Collaborative-Based Networking" used HTML parsing methods, but with important details [2].
The test is included to calculate the accuracy of this research paper and the effectiveness of the process indicated.
German author JAN KINE A N D JANNA AXENBECK published in 2019 in the article Web Mining of Firm Websites: A Foundation for Web Scraping and Research Analysis, the ARGUS web scraper method used, tabs in future research, analysis of the download information network and other subsystems of the innovation ecosystem.Inclusion [3].
In a 2019 article by authors Alex Bradley and Richard J. E. James using R from Web Scraping, they use the R language web scraper method, in this article they provide a description of the R environment and how to download and install the R package [4].Alex Bradley and Richard J. E. James' book was used in 2018 for copy and paste, parsing HTML, parsing DOM (Data Model), computer vision web analyzer, and web scraping software for web scraping method, in this article they just discuss the basics of web mining [4].
Web Scraping Using Machine Learning Author VICTOR CARLE In an article published in 2022, Web Scraping Software web scraper method using machine language, according to this theory, there are some problems in calculating truth that can increase or decrease truth [5].

Methodology Used
When we send a request to a server, the server sends the requested information or website in response and displays it in our browser.We convert HTML files to Python files before displaying the browser server response.We also save website data in CSV files.The following steps are used to accomplish the task:

Fetching the HTML content (Using Requests).
Our first step is to get the HTML content using the HTML request as a string.With the help of the application library, we can fetch the file using the given URL.Here we collect our data in different ways such as receiving, publishing, and deletion.

Parse the HTML (Using HTML Parse & Beautiful Soup)
HTML Parser is used to convert HTML string to format.Where we see the tree model in the law.HTML Parser is used to convert HTML string to format.

HTML Tree traversal.
We see the tree model in the law.Image-Display DOM treelike model.With the help of such a tree, we get information from web pages.We use the class and id given for the current Usage of Web Scraping in the Pharmaceutical Sector 3 element in the HTML code of the web page from the data we dump.Nice soup is a pattern in Python for retrieving data in a hierarchical fashion.Retrieve, Share, and Delete modes to process our data.With the help of this tree, we extract information from web pages.We use the class and id given for the current element in the HTML code of the web page from the data we dump.

Results
As we can see from Figure 2, there are columns for drug names, manufacturers, drug types, and prices.This is the information we get from a website called Net meds, a pharmacy site.With the help of this information, we learn which drugs are most needed, and then we find the most common diseases today.

Conclusion
Web scraping is a process where we extract data from the web, convert the HTML code into a Python file, and then save it as a CSV file.Web Scraping Application in Medicine to collect data on the most used drugs to find the most common diseases by drug type.a website called Net meds, a pharmacy site.With the help of this information.

Figure 1 .
Figure 1.DOM tree like structure

Figure 2 .
Figure 2. DOM tree like structure

Table 1 .
Related Work on Web Scraping