Sorting by

×

AI – Artifical Inteligence


    +

    Stories by Scrapingdog on Medium

  • How To Scrape Websites With Google Sheets
    Web scraping is a process of collecting data from the Internet for price aggregation, market research, lead generation, etc. But web scraping is mainly done by major programming languages like Python, Nodejs, or PHP due to this many non-coders found it very difficult to collect data from the internet. They... Read more »
  • Scrape LinkedIn Jobs at Scale
    Are you trying to build a Job board? If yes then today I will show you how you can pull job data from websites like Linkedin. For this tutorial, we will use LinkedIn Job Scraping API which will help us scrape job data from LinkedIn without getting blocked.RequirementsWe will use Python... Read more »
  • How to Get Flight Status Data With an API?
    We will sign up for a Flight Status API. This API provides free 30 credits for testing. Before we start coding you should read the documentation of this API. We will be using Python 3.x for this example. I am hoping that you have already installed Python on your machine... Read more »
  • Scraping Yelp Data using Python (A Comprehensive Guide-DUP)
    In this tutorial, we will scrape Yelp and build our Yelp scraper using Python. We’re going to use the power of this programming language to extract valuable insights from Yelp’s rich and extensive database.Whether you’re a budding data scientist, a curious programmer, or a business analyst seeking novel ways to... Read more »
  • How to get employee details of a company
    IntroductionRequirementsI hope you have already installed Python 3.x on your machine and if not then you can install it from here. Once that is done you should create a folder in which we will keep our Python scripts.mkdir employeecd employeeOnce you are inside your employee folder install these public Python libraries.Requests–... Read more »
  • How To Use A Proxy With Axios And Node JS
    Nodejs offers multiple HTTP client options and Axios is one of them. Axios has by far the best community support compared to other libraries like Fetch, Unirest, etc. It provides a stable API through which you can make XMLHttpRequests. Using a middleware-like function you can customize the pattern of request.... Read more »
  • Web Scraping Myntra with Selenium and Python
    Today many websites cannot be scraped with a normal XHR request because they render data through Javascript execution. Traditional web scraping libraries like requests and Scrapy are excellent for extracting data from websites where the content is directly embedded in the HTML of the page. However, a growing number of... Read more »
  • Web Scraping with Playwright and Nodejs
    Playwright is another popular open-source browser automation Nodejs library. It makes browser automation super simple. It is fast and lightweight and requires very few lines of code in order to implement any web scraping task. It provides support for almost all popular browsers like Firefox, Chromium, etc.Playwright can help you... Read more »
  • How To Web Scrape Google Search Results using Python Beautifulsoup
    In today’s blog, we’ll be diving into web scraping Google Search results, here we will use Python and BeautifulSoup to extract valuable information. We will make a Google Search scraper of our own that can automate the process of pulling URLs, data, and insights. I have made a dedicated tutorial... Read more »
  • Best Amazon Scraper
    In today’s data-driven world, extracting valuable insights from e-commerce giants like Amazon has become paramount. Whether you’re a business owner seeking competitive intelligence, a researcher analyzing market trends, or a developer building a price comparison tool, web scraping Amazon data is an indispensable skill.However, the world of web scraping APIs... Read more »
    +

    Stories by Ishaan Gupta on Medium

  • System Design — Horizontal vs. Vertical Scaling From Scratch
    System Design — Horizontal vs. Vertical Scaling From ScratchCredit: Link“The art of scalability is understanding the difference between horizontal and vertical growth and knowing when to apply each.” — Martin FowlerWhat Is Scalability?Scalability refers to the ability of a system to handle increasing amounts of workload or requests without sacrificing performance or incurring excessive costs. Scalability... Read more »
  • 10 Important Python Interview Questions (for 2024)
    Ace Your Interviews with Confidence!1.) What are Python decorators and how do you use them?Python decorators are a powerful feature that allows you to modify or extend the behaviour of functions or methods. Decorators provide a clean and concise way to wrap or decorate functions with additional functionality. In this blog... Read more »
  • System Design — Caching from Scratch (Part 1)
    System Design — Caching from Scratch (Part 1)“There are only two hard things in Computer Science: cache invalidation and naming things.” — Phil KarltonIntroductionIn the world of system design, optimizing the performance of applications is a critical aspect. Caching plays a pivotal role in enhancing the speed and efficiency of systems by storing frequently accessed data... Read more »
  • 10 Killer Websites for Web Developers!
    99% of developers don’t know of them!Hey, check out these 10 cool websites I stumbled upon today. I bet you’ll find them pretty interesting!1) ReadmeEffortlessly craft a README file with this intuitive editor, enabling you to swiftly incorporate and personalize all the requisite sections for your project’s readme.website link — Link2) CodePenUsing CodePen... Read more »
  • 5 Exceptional Python Frameworks for Frontend Development
    Credits: pixelfit on iStock1.) FletDiscover the power of Flet — a dynamic framework inspired by Flutter, the renowned creation from Google. Elevate your development experience as Flet empowers you to craft engaging web, desktop, and mobile applications effortlessly, all with the simplicity and expressiveness of Python programming.Unleash your creativity with Flet’s flexibility, offering... Read more »
  • Promise Patterns vs. Async/Await: A Developer’s Guide
    Difference Between Promise and Async/Await explained!In JavaScript, asynchronous operations are a fundamental concept that allows you to perform tasks without blocking the main thread of execution. Promises and async/await are two different ways to handle asynchronous operations.1.) PromisesPromises are a way to manage asynchronous operations in JavaScript. They provide a... Read more »
  • Support for password authentication was removed. Please use a personal access token instead!
    While pushing some codes into your GitHub repository you may encounter the error “Support for password authentication was removed. Please use a personal access token instead.” as shown picture below.Starting from August 13, 2021, GitHub has stopped accepting passwords for verifying Git operations on user accounts. Instead, users are now required... Read more »
  • AI-Generated Influencer Makes 10,000$ Per Month!
    The Clueless, a modeling agency located in Barcelona, has created a stir by unveiling Aitana López, Spain’s first AI influencer. This marks a revolutionary change in the landscape of the fashion industry.The Birth of Aitana LópezIn an interview with the media, Rubeñ Cruz, the creator of The Clueless, revealed that the... Read more »
  • 5 Exceptional Python Tools To Enhance Your Productivity
    Effortless Coding with 5 Essential Python ToolsImage by wayhomestudio on Freepik1.) howdoiI believe even seasoned programmers frequently resort to searching for solutions to basic programming tasks on Google. This tool enables you to perform such searches directly from the command line, eliminating the need to open your browser for assistance. It has... Read more »
  • 5 Useful Python Libraries You Should Use in Your Projects
    Useful Python Libraries!Credit: FreeImagesPython is a versatile programming language that can be used for a wide range of tasks, from data science to web development to automation. But even the most skilled Python developers rely on top-notch libraries to streamline their work and achieve their desired results.Ready to elevate your Python... Read more »