Web Scraping Data
Objective
The purpose of this document is to provide a comprehensive guide for the developer to extract
relevant trading data from TradingView's platform using web scraping techniques. The objective
is to collect real-time and historical data for different trading strategies, including top-performing
strategies, recent trades, detailed performance metrics, and trade status. This data will be used
for predictive analytics, risk assessment, performance tracking, and real-time alert notifications.
Scope of Web Scraping
The scope of the web scraping work includes gathering all necessary data points required for
accurate strategy performance analysis, risk management, and alert generation. The system will
collect, process, and store this data for both real-time monitoring and historical analysis. Key
data points to be scraped and their relevance are listed below:
Dashboard
1. Top Trading Strategies and Performance Data
● Data to Extract:
○ Net Profit: Extract percentages for each strategy.
○ Win Rate: Extract win rates for each strategy.
○ Total Trades: Extract the number of trades for each strategy.
○ Performance over Different Periods that will be calculated on behalf of the
data extraction.
■ 7 Day Performance
■ 30 Day Performance
■ 90 Day Performance
2. Detailed Strategy Data (Tables)
● Data to Extract:
○ Asset, Market, Timeframe: Information for each strategy.
○ Net Profit, Win Rate, Profit Factor, and Sharpe Ratio: These are key
performance metrics.
○ Trades Information: Capture the number of trades and corresponding 7, 30, and
90-day performance data.
3. Recent Trades
● Data to Extract:
○ Trade Type (Long or Short)
○ Entry and Exit Prices
○ Profit/Loss
○ Duration of Trade
4. Performance Details
● Data to Extract:
○ Net Profit
○ Gross Profit
○ Gross Loss
○ Max Run-up
○ Max Drawdown
○ Buy & Hold Return
○ Sharpe Ratio
○ Sortino Ratio
○ Profit Factor
○ Max Contracts Held
○ Open PL
○ Commission Paid
○ Total Closed Trades
○ Total Open Trades
○ Number Winning Trades
○ Number Losing Trades
○ Percent Profitable
○ Avg Trade
○ Avg Winning Trade
○ Avg Losing Trade
○ Ratio Avg Win / Avg Loss
○ Largest Winning Trade
○ Largest Losing Trade
○ Avg # Bars in Trades
○ Avg # Bars in Winning Trades
○ Avg # Bars in Losing Trades
○ Margin Calls
5. Latest Trading Signals and Trade Status
● Data to Extract:
○ Latest Signals: For each strategy (e.g., "EMA Crossover Pro"), capture the
signal like "BUY" or "SELL" with time indicators.
○ Trade Status: Whether the trade is open or closed.
6. Combined Performance for Favorites
● Data to Extract:
○ Combined 7 and 30 Day Performance: Percentage values for overall strategy
performance will be calculated on behalf of data extraction.
○ Favorite Strategies: List of strategies marked as favorites with their respective
assets, net profits, win rates, and total trades.
○ Active Trades: Number of active trades.
7. Required Approach for Web Scraping
1. Data Extraction:
○ Use scraping tools such as BeautifulSoup or Selenium to extract the data
points from HTML elements.
○ If the data is presented in charts, consider using OCR (Optical Character
Recognition) techniques or identifying if the data is available as text in a
backend data structure.
2. Data Parsing:
○
Ensure the parsed data is structured well (e.g., saving it in a CSV or database for
future use).
○ Handle multiple pages (pagination) to gather data from all available strategies.
3. Handling dynamic content:
○ If the data loads dynamically (through JavaScript), Selenium can be used to
interact with the page and fetch all relevant data.
8. URL
https://www.tradingview.com/
9. ID:
Email- [email protected]
Password- Ais@I*123456789012
