Scrapegraph Sdk

scrapegraph-pysdk-nodejscookbookscrapingjson-schemagithub-trendingsdk-pythonweb-scraping-pythonweb-scrapingsdk-jsapiPythonscrapegraphweb-crawler

๐Ÿ•ท๏ธ Extract Github Trending Repositories with Official Scrapegraph SDK

Open in Alph Open In Colab

scrapegraph banner

๐Ÿ”ง Install dependencies

[1]

๐Ÿ”‘ Import ScrapeGraph API key

You can find the Scrapegraph API key here

[2]
Scrapegraph API key:
 ยทยทยทยทยทยทยทยท

๐Ÿ“ Defining an Output Schema for Webpage Content Extraction

If you already know what you want to extract from a webpage, you can define an output schema using Pydantic. This schema acts as a "blueprint" that tells the AI how to structure the response.

Pydantic Schema Quick Guide

Types of Schemas

  1. Simple Schema
    Use this when you want to extract straightforward information, such as a single piece of content.
from pydantic import BaseModel, Field

# Simple schema for a single webpage
class PageInfoSchema(BaseModel):
    title: str = Field(description="The title of the webpage")
    description: str = Field(description="The description of the webpage")

# Example Output JSON after AI extraction
{
    "title": "ScrapeGraphAI: The Best Content Extraction Tool",
    "description": "ScrapeGraphAI provides powerful tools for structured content extraction from websites."
}
  1. Complex Schema (Nested)
    If you need to extract structured information with multiple related items (like a list of repositories), you can nest schemas.
from pydantic import BaseModel, Field
from typing import List

# Define a schema for a single repository
class RepositorySchema(BaseModel):
    name: str = Field(description="Name of the repository (e.g., 'owner/repo')")
    description: str = Field(description="Description of the repository")
    stars: int = Field(description="Star count of the repository")
    forks: int = Field(description="Fork count of the repository")
    today_stars: int = Field(description="Stars gained today")
    language: str = Field(description="Programming language used")

# Define a schema for a list of repositories
class ListRepositoriesSchema(BaseModel):
    repositories: List[RepositorySchema] = Field(description="List of GitHub trending repositories")

# Example Output JSON after AI extraction
{
    "repositories": [
        {
            "name": "google-gemini/cookbook",
            "description": "Examples and guides for using the Gemini API",
            "stars": 8036,
            "forks": 1001,
            "today_stars": 649,
            "language": "Jupyter Notebook"
        },
        {
            "name": "TEN-framework/TEN-Agent",
            "description": "TEN Agent is a conversational AI powered by TEN, integrating Gemini 2.0 Multimodal Live API, OpenAI Realtime API, RTC, and more.",
            "stars": 3224,
            "forks": 311,
            "today_stars": 361,
            "language": "Python"
        }
    ]
}

Key Takeaways

  • Simple Schema: Perfect for small, straightforward extractions.
  • Complex Schema: Use nesting to extract lists or structured data, like "a list of repositories."

Both approaches give the AI a clear structure to follow, ensuring that the extracted content matches exactly what you need.

[ ]

๐Ÿš€ Initialize SGAI Client and start extraction

Initialize the client for scraping (an async version using AsyncScrapeGraphAI is available here).

[4]

Use the extract method to pull structured data from a URL with AI. The same method also accepts raw html= or markdown= if you already have the page content.

[5]

Print the response

[6]
Tokens used: prompt_tokens=45006 completion_tokens=36908
Trending Repositories:
{
  "repositories": [
    {
      "name": "OMNeT++ NED",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "OMNeT++ MSG",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "ooc",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Opa",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Opal",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Open Policy Agent",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "OpenAPI Specification v2",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "OpenAPI Specification v3",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "OpenCL",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "OpenEdge ABL",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "OpenQASM",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "OpenRC runscript",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "OpenSCAD",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "OpenStep Property List",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "OpenType Feature File",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Option List",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Org",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "OverpassQL",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Ox",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Oxygene",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Oz",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "P4",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Pact",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Pan",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Papyrus",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Parrot",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Parrot Assembly",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Parrot Internal Representation",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Pascal",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Pawn",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "PDDL",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "PEG.js",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Pep8",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Perl",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "PHP",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Pic",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Pickle",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "PicoLisp",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "PigLatin",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Pike",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Pip Requirements",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Pkl",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "PlantUML",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "PLpgSQL",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "PLSQL",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Pod",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Pod 6",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "PogoScript",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Polar",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Pony",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Portugol",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "PostCSS",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "PostScript",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "POV-Ray SDL",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "PowerBuilder",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "PowerShell",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Praat",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Prisma",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Processing",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Procfile",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Proguard",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Prolog",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Promela",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Propeller Spin",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Protocol Buffer",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Protocol Buffer Text Format",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Public Key",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Pug",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Puppet",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Pure Data",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "PureBasic",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "PureScript",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Pyret",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Python",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Python console",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Python traceback",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "q",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Q#",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "QMake",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "QML",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Qt Script",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Quake",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "QuakeC",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "QuickBASIC",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "R",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Racket",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Ragel",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Raku",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "RAML",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Rascal",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "RAScript",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Raw token data",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "RBS",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "RDoc",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Readline Config",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "REALbasic",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Reason",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "ReasonLIGO",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Rebol",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Record Jar",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Red",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Redcode",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Redirect Rules",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Regular Expression",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Ren'Py",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "RenderScript",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "ReScript",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "reStructuredText",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "REXX",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Rez",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Rich Text Format",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Ring",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Riot",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "RMarkdown",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "RobotFramework",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "robots.txt",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Roc",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Rocq Prover",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Roff",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Roff Manpage",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "RON",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "ROS Interface",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Rouge",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "RouterOS Script",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "RPC",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "RPGLE",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "RPM Spec",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Ruby",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "RUNOFF",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Rust",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Sage",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Sail",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "SaltStack",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "SAS",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Sass",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Scala",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Scaml",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Scenic",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Scheme",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Scilab",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "SCSS",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "sed",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Self",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "SELinux Policy",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "ShaderLab",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Shell",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "ShellCheck Config",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "ShellSession",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Shen",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Sieve",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Simple File Verification",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Singularity",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Slang",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Slash",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Slice",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Slim",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Slint",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Smali",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Smalltalk",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Smarty",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Smithy",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "SmPL",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "SMT",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Snakemake",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Solidity",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Soong",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "SourcePawn",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "SPARQL",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Spline Font Database",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "SQF",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "SQL",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "SQLPL",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Squirrel",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "SRecode Template",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "SSH Config",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Stan",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Standard ML",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "STAR",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Starlark",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Stata",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "STL",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "STON",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "StringTemplate",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Stylus",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "SubRip Text",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "SugarSS",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "SuperCollider",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "SurrealQL",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Survex data",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Svelte",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "SVG",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Sway",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Sweave",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Swift",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "SWIG",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "SystemVerilog",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Tact",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Talon",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Tcl",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Tcsh",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Tea",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Teal",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "templ",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Terra",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Terraform Template",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "TeX",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Texinfo",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Text",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "TextGrid",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Textile",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "TextMate Properties",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Thrift",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "TI Program",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "TL-Verilog",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "TLA",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "TMDL",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Toit",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "TOML",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Tor Config",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Tree-sitter Query",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "TSPLIB data",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "TSQL",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "TSV",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "TSX",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Turing",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Turtle",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Twig",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "TXL",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Type Language",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "TypeScript",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "TypeSpec",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Typst",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Unified Parallel C",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Unity3D Asset",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Unix Assembly",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Uno",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "UnrealScript",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Untyped Plutus Core",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "UrWeb",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "V",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Vala",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Valve Data Format",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "VBA",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "VBScript",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "vCard",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "VCL",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Velocity Template Language",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Vento",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Verilog",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "VHDL",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Vim Help File",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Vim Script",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Vim Snippet",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Visual Basic .NET",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Visual Basic 6.0",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Volt",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Vue",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Vyper",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Wavefront Material",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Wavefront Object",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "WDL",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "Web Ontology Language",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "WebAssembly",
      "description": "No content available",
      "stars": 0,
      "forks": 0,
      "today_stars": 0,
      "language": "No content available"
    },
    {
      "name": "bytedance/UI-TARS-desktop",
      "description": "The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra",
      "stars": 32540,
      "forks": 3220,
      "today_stars": 669,
      "language": "TypeScript"
    },
    {
      "name": "anthropics/financial-services",
      "description": "No content available",
      "stars": 19518,
      "forks": 2533,
      "today_stars": 1449,
      "language": "Python"
    },
    {
      "name": "addyosmani/agent-skills",
      "description": "Production-grade engineering skills for AI coding agents.",
      "stars": 38959,
      "forks": 4307,
      "today_stars": 1065,
      "language": "Shell"
    },
    {
      "name": "CloakHQ/CloakBrowser",
      "description": "Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 30/30 tests passed.",
      "stars": 5220,
      "forks": 393,
      "today_stars": 496,
      "language": "Python"
    },
    {
      "name": "HKUDS/AI-Trader",
      "description": "\"AI-Trader: 100% Fully-Automated Agent-Native Trading\"",
      "stars": 15898,
      "forks": 2553,
      "today_stars": 163,
      "language": "Python"
    },
    {
      "name": "jundot/omlx",
      "description": "LLM inference server with continuous batching & SSD caching for Apple Silicon -- managed from the macOS menu bar",
      "stars": 13467,
      "forks": 1144,
      "today_stars": 185,
      "language": "Python"
    },
    {
      "name": "datawhalechina/easy-vibe",
      "description": "\ud83d\udcbb vibe coding 2026 | Your first modern Coding course for beginners to master step by step.",
      "stars": 9488,
      "forks": 914,
      "today_stars": 635,
      "language": "JavaScript"
    },
    {
      "name": "playcanvas/supersplat",
      "description": "3D Gaussian Splat Editor",
      "stars": 7001,
      "forks": 778,
      "today_stars": 579,
      "language": "TypeScript"
    },
    {
      "name": "lsdefine/GenericAgent",
      "description": "Self-evolving agent: grows skill tree from 3.3K-line seed, achieving full system control with 6x less token consumption",
      "stars": 10714,
      "forks": 1205,
      "today_stars": 174,
      "language": "Python"
    },
    {
      "name": "decolua/9router",
      "description": "Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.",
      "stars": 7644,
      "forks": 1262,
      "today_stars": 803,
      "language": "JavaScript"
    },
    {
      "name": "affaan-m/everything-claude-code",
      "description": "The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.",
      "stars": 178795,
      "forks": 27573,
      "today_stars": 1081,
      "language": "JavaScript"
    },
    {
      "name": "datawhalechina/hello-agents",
      "description": "\ud83d\udcda \u300a\u4ece\u96f6\u5f00\u59cb\u6784\u5efa\u667a\u80fd\u4f53\u300b----\u4ece\u96f6\u5f00\u59cb\u7684\u667a\u80fd\u4f53\u539f\u7406\u4e0e\u5b9e\u8df5\u6559\u7a0b",
      "stars": 47116,
      "forks": 5669,
      "today_stars": 748,
      "language": "Python"
    }
  ]
}

๐Ÿ’พ Save the output to a CSV file

Let's create a pandas dataframe and show the table with the extracted content

[17]

Save it to CSV

[8]
Data saved to trending_repositories.csv

๐Ÿ”— Resources

Made with โค๏ธ by the ScrapeGraphAI Team