OSM Credibility
Analysis
How to evaluate credibility in OSM?
• Evaluating credibility on social media involves analyzing user behavior,
content authenticity, network interactions, and external verification
methods.
Key Factors for Credibility Evaluation
• User Profile Analysis
• Account Age
• Follower / Following Ratio
• Profile Completeness
• Verification Badge
• Content Analysis
• Linguistic Features
• Grammar and Spelling
• Image and Video Verification
• Fact based information
• Engagement & Interaction Patterns
• Engagement Authenticity
• Comment Quality
• Timing and Frequency
• Echo chambers(misinformation bubbles)
• External Fact – checking
• Cross-referencing
Computational Approach
• Machine Learning & NLP-Based Credibility Evaluation
• Network Based Credibility Analysis
• Bot & Fake Account Detection
•Botometer (Indiana University) – Analyzes Twitter account credibility.
•Spam Detection – Detects automated posting patterns using ML models.
Machine Learning & NLP-Based
Credibility Evaluation
1. Collect Data
•Use social media APIs (Twitter, Facebook, Reddit) to gather posts and user data.
•Use misinformation datasets like FakeNewsNet or LIAR.
2. Feature Engineering
•User Features: Account age, follower count, posting frequency.
•Content Features: Sentiment, lexical diversity, fact-checking citations.
•Engagement Features: Retweet/like ratios, network diffusion speed.
3. Train a Credibility Model
•Use Random Forest, Logistic Regression, or Deep Learning (BERT, LSTM) for
classification.
Network-Based Credibility
Analysis
•Graph-Based Techniques (e.g., using NetworkX) analyze how fake
news spreads.
•Retweet Graphs – Identify fake news clusters where misinformation
circulates within closed groups.
•Influencer Detection – Identify trusted vs. misleading influencers.
Open Source tools for credibility
• Hootsuite: A popular tool for social media monitoring, scheduling posts, and analyzing
trends.
• Social Search: Allows you to track specific social media posts, hashtags, and mentions.
• BuzzSumo: Helps you analyze trends, find influencers, and track content performance on
social media.
• Maltego: A powerful tool for data mining and linking social media profiles to other data
points.
• TweetDeck: A tool for monitoring Twitter, tracking hashtags, mentions, and managing
multiple accounts.
• Mention: Monitors social media for brand mentions, trending topics, and competitor
analysis.