Frequently Asked QuestionsFrequently Asked Questions
Don't see your question below? Contact us!---
1. I created a new account but I still can’t log in, why?
After registering, you should have received an e-mail confirming your registration. Open that e-mail and click on the provided link to complete the registration process. If you have not received the e-mail, please check your spam folder or contact us to help resolve the issue.
2. Scraawl does not accept my password. What should I do?
Make sure your password is at least 8 characters long and contains at least one letter, one number, and one of the following special characters: ! @ * # $ _% ^
3. I forgot my password. What should I do?
Use the Forgot password? link on the Scraawl home page, and follow the instructions to reset your password.
4. How do I close or delete my Scraawl account?
Go to your My Profile page and click on the Delete Scraawl Account button at the bottom of the page.
1. What social media feeds can I analyze in Scraawl?
Scraawl can analyze data from Twitter, Facebook, Tumblr, YouTube, VK, RSS, and news feeds. Users can import their data (obtained via a third party tools such as GNIP or public API’s) and use Scraawl’s analytics to find actionable insights.
2. Why does Scraawl require an app token, or ask me to link my account with Scraawl to collect data from social media feed? How does Scraawl use my app/token data?
Due to recent restrictions imposed by the social media data providers regarding data collection and use of their data, Scraawl does not collect data from certain social media feeds. If users want to use Scraawl’s managed access API’s to collect data to access their data from these sites, using the feed’s public API’s, Scraawl can be configured to do so. In such cases, depending on the social media feed, and their terms of service, Scraawl may require users to create and link an application/user token that is approved by the social media site, and configure a dedicated collection service. We respect user privacy, therefore data collected on behalf of a user is neither shared nor distributed to any third party or third party application. Contact us if you’d like to use Scraawl’s managed API’s for data collection.
3. If I link my account with Scraawl is my personal user token shared with other Scraawl users?
No. Your user account and associated application token is only used when you create reports with your Scraawl login. Other Scraawl users either use Scraawl’s dedicated application tokens or their own personal tokens. You can always choose to unlink your personal social media accounts from the My Profile page.
4. What is the difference between Basic, Premium, and Premium Advanced Search?
Basic Search will be discontinued soon. Premium and Premium Advanced Search are only available for Lite, Professional, Premium account holders. Premium Search provides a much wider range of search options such as streaming and historic search, as well as search by region, user, language, etc. Premium search also provides managed access to a feed. The number of posts returned can be specified up to the max report quota allowed by your plan (see My Profile page). Premium Advanced Search allows users to write custom queries using Boolean logic and advanced search operators.
5. What happens when I enter multiple search terms in the search keyword field? Is this AND or OR logic?
In Basic and Premium Search, multiple keywords separated with commas are executed as OR logic, i.e., posts that contain one or more of the keywords are returned. Multiple keywords separated by spaces are executed as AND logic, i.e., posts that contain all keywords are returned. Premium Advanced Search uses a separate search grammar and the details of the grammar can be found here: https://www.scraawl.com/product/gnip-search-powertrack-rules/
6. What is brand monitoring?
Brand Monitoring is a search used to collect posts related to a brand’s social media account (posted by or mentioning) for purposes of brand reputation management. Up to 10 brand handles can be tracked in a single report. Brand reports appear in a designated area on the My Reports page. Brand reports include the Social Metrics advanced analytic which provides statistics on a brand’s reach, engagement, and impressions. Social Metrics is not available for regular search reports.
7. Can I search a social media feed in multiple languages?
Yes. With Scraawl you can search across 100+ languages. Use the Translate keywords function to enter keywords in other languages. Any foreign language posts returned from your search can also be translated into English using Scraawl’s Translate function which is integrated throughout the tool.
8. Why does every feed have different search options?
The choice of search options is driven, in part, by the APIs available from the data providers. Feeds with richer APIs provide a wider range of search options.
9. What is the difference between Streaming, Historic, and Recent when conducting a search?
Streaming should be used if you are interested in collecting REAL-TIME data. That is, posts matching your search criteria will be captured as they are posted (until you reach your report quota). This is often referred to as “listening” in social media. Depending on the current social media activity matching your search criteria, your search may take time to return any posts. The Historic and Recent search options go back into the specified time window to find posts matching your search criteria that have ALREADY been posted.
10. I started my search but don't see any results. Why?
Once you start Scraawling, it can take up to two minutes for the first batch of search results to be returned. New results are then returned in batches every 3 minutes.
11. My search is not returning any results even after 5 minutes. Why?
Make sure that your keywords are not too constraining. Try using broader search criteria.
12. What can I collect and analyze with a Twitter, Tumblr, YouTube, News or Blog search?
A Premium or Premium Advanced historic/streaming query will search the respective feed to find posts matching the search criteria as specified in your search query and return them in a report. All analytics that are computed are done in the context of the posts in this report. The numbers of posts downloaded for analysis depends on the report limit as specified by you (within the quota bounds of your plan) and on the limits imposed by the data source. When there are more posts available than the report limit, the most recent posts are downloaded.
13. What can I collect and analyze with a Facebook Search ?
Scraawl can analyze Facebook page data user data and compute various social metrics related to reach and engagement. Scraawl’s managed access APIs can only be configured to collect data from public pages, using user provided tokens. When performing Brand Monitoring, posts from the last 30 days for up to 5 public brand pages are downloaded and analyzed.
14. I get an error when I try to search for a brand in a Facebook Brand Report. What gives?
If you’re not able to search for the name of a Facebook page, group, or event try these rules for your brand report:
- If the Facebook page URL ends in a numeric string, use it to create Scraawl report.
- E.g., when searching for this page: https://www.facebook.com/pg/scraawl-100078, use 100078 as the search term
- If the Facebook URL does not end in numeric string then use the name of the page.
- E.g., when searching for this page: https://www.facebook.com/homedepot/ use homedepot
- E.g., when searching for this page: https://www.facebook.com/harley-davidson/ use harley-davidson
15. How far can I search with Scraawl's Facebook search?
While your search results may depend on the amount data found and your quota limits, Facebook Premium Search goes back one year and Facebook brand reports go back one month.
16. Does Scraawl SocL support wildcard or approximation searches
Scraawl SocL does not support wildcard, asterisk, or approximation searches. Key terms are taken in as they are. For example, in order to find all plural variants of a subject such as the word “Apple”, users will have to input (Apple OR Apples).
17. What is the keyword limit for Twitter searches?
Twitter searches have a maxium of 10 keywords with a 500 character limit that includes operators such OR.
1. What search logic applies to news feed reports?
In Premium Search, it is an AND/OR logic with keyword searches. In Premium Advanced Search it is Boolean logic with advanced search expressions. These expressions and operators can be found here or under the search box in blue text in Premium Advanced Search.
2. How many news sources does Scraawl have access to?
Scraawl has over 5,000 news sources and that number continues to grow. You can search our repository here or by going to the RSS Advanced Rules page and clicking on the link under the operator source: to check what news sources are available for search. Please note, news feeds as a data source began in January 2017 and so no articles published before that time are searchable in Scraawl.
3. Can I request the addition of a news source?
To request the addition of a news source please, send it to firstname.lastname@example.org.
4. What search operators are available in Premium Advanced Search?
Search operators for news feed Premium Advanced Search are available under RSS Advanced Search rules. This list is also available under the search box in Premium Advanced Search. Operators include:
“exact phrase match”
point_radius:[lon lat radius]
5. Which regions and countries can I search for in news feed Premium Advanced Searches?
A searchable list of countries and regions can be found on the RSS Advanced Search Rules page under the country: operator. In this section, you will see a drop down menu where you can search for countries or regions by typing. This list is also accessible by clicking the RSS Advanced Search Rules link in Premium Advanced Search.
6. Can I search news articles in Raw Data?
Many of the search operators from Advanced Search such as country: and category: are also available as search “operators ” tip in Raw Data, however, please refer to the “operators” under the Raw Data search box for the full list.
7. Can I run a streaming search with News Feeds?
Streaming search is not yet available in news feeds searches. You can, however, collect most recent articles that match your search query with the news feeds historic search option.
1. How many reports can I set up and how many posts can I collect per report?
The number of reports allowed, and posts per report depends on your account privileges. Go to the My Profile page to see your account privileges. There are limits on the number of Search Reports, Streaming Reports, Brand Reports, Archived Reports, Shared Reports, and Case Reports.
2. Is there a limit to the number of reports I can share?
Yes, your account type determines the number of reports that you can share. Check the My Profile page to see your account privileges.
3. What is a Streaming Report?
A Streaming Report is one that has a search in progress. On the My Report page, Streaming Reports will be highlighted in green and show status as Running.
4. Can I stop a streaming search?
A streaming search can be stopped at any time by selecting Stop Report from the Actions pulldown on the My Reports page or on the page of the report itself.
5. I get a message that I have to archive or delete a report before creating a new one, why?
Your profile allows you to have a certain number of reports. You will get this message if you’ve reached your limit and are trying to create a new report. You can delete or archive one or more of your existing reports to get around this. Note that the number of archived reports is also limited – Check the My Profile page to review your limits. Different account types have different report limits. Contact us if you are interested in upgrading your account.
6. What does it mean if a report’s status shows as edited?
This means that you have applied some filters (or excluded some posts). Once a report has been filtered, use the Update statistics button to refresh the Basics Statistics calculations to reflect the selected data. Similarly, you can use the Update analytics button to refresh any of the Advanced Analytics. The original full dataset can easily be retrieved using Undo All Edits from the Actions pulldown.
7. My report says it is complete even before the timeout duration. Why?
A report is considered complete when the number of posts collected reaches the Maximum Posts per Report limit (which can be found on your My Profile page).
8. My report stopped with a timeout notification even before it reached the maximum posts per report. Why?
A search is considered timed out when the search has been executing for the duration as defined by the Report Timeout period specified on your My Profile page. At this point the search will timeout even if the post count in the report is less that the maximum allowable tweets per report.
9. How do I share a report with someone else?
You can share a report with anyone using the Share/Unshare feature which can be accessed from the Actions pulldown. Both streaming and completed reports can be shared. To share a report, enter the e-mail address of the person with whom you want to share the report. That person will receive an e-mail informing them that a report has been shared with them. If the person does not have a Scraawl account, he/she will have to register with Scraawl to see the report.
10. Can I stop sharing a report?
Yes, if you are the owner of the report, you can revoke access to a particular recipient or all recipients of a shared report. To revoke access, select Share/Unshare from the Actions pulldown and then select Revoke Access for individual users. The Revoke All button can be used to revoke access to any or all users.
11. Where can I see a list of reports that have been shared with or by me?
All shared reports can be seen in the My Folders section of the My Reports page. Shared Reports includes reports you have shared with others. Reports Shared With Me includes reports others have shared with you.
12. I shared a report with a user and they cannot see the raw data or run any analytics. Why?
Only the owner of a report can see the raw data and run analytics on a report. All viewers of a shared report have read-only access – they will see any filters you have applied and any analytics you have run.
13. What are case reports?
You can bookmark posts from any report (or from multiple reports) and export them to a Case Report. Case Reports then behave like any other report – you can see Basic Statistics, Advanced Analytics, and Raw Data.
1. What are basic statistics and how are the computed?
Once posts that match your search criteria are collected, Scraawl computes Basic Statistic related to top users, words, hashtags, mentions, URLs, retweets, languages, and locations. The top 50 for each of these categories are shown, with each element acting as an interactive drill-down for data exploration, and an option to filter and exclude posts associated with selected elements. For historic data (collected using Historic or Recent), basic statistics are computed once all the posts that match the search criteria are retrieved. For streaming searches the statistics are updated every 2 minutes. Note that only those basic statistics that are relevant to the data feed are computed.
2. Why do different feeds have different sets of basic statistics and advanced analytics?
Not all statistics and analytics are relevant to all feeds. Only those statistics and analytics that can be computed from the available post data and metadata are included for each feed.
3. How can I use the Basic Statistics to explore and manipulate my data?
Each element in any of the Basic Statistics (e.g., Top Users, Top Words, etc.) can be used as an interactive drill-down to see the posts associated with the element. This can be done from the elements displayed in the Basic Statistics dashboard or from the full list of elements displayed when the Details button is clicked. Click the Filter button on the Details page to select individual elements, and then click the Exclude selected button to hide the posts associated with the selected elements. Use Undo All Edits from the Actions menu to undo any applied filters and get back to your full data set.
4. Why am I able to see some user profiles in Scraawl and for others I am redirected to the social media feed?
Scraawl only collects user profiles for the top 50 users in the report. For profiles of the other users (e.g., those mentioned in a post), Scraawl redirects you to the social media site to view the user profile.
5. What is the difference between geo-coded, geo-profiled and geo-referenced posts?
Geographic data is associated with posts in three ways: (1) If the user has location services turned on, the post is geo-coded using GPS coordinates. (2) If the user has a geographic location specified in his/her profile, the post is geo-profiled. (3) If the user mentions a geographic location in the body of the post, the post is geo-referenced. Given these definitions, it is possible for a post to be associated with multiple locations, e.g., a user from Washington DC tweets about upcoming trip to Paris while visiting friends in Pittsburgh Pennsylvania with location services on.
1. What advanced analytics does Scraawl offer?
Scraawl offers a wide range of Advanced Analytics including geo-spatial analytics, social network analytics, content/text analytics, behavioral analytics, and image analytics. Please visit https://www.scraawl.com/product/features/ for a full list of available analytics
2. Are all advanced analytics available for all social media feeds?
No. Advanced Analytics vary by feed type, and depend in-part on the data that is available from the social media feed. Only those Advanced Analytics relevant to a particular feed are shown in the advanced analytics tab of the report.
3. What is the Heat Map?
The Heat Map provides a graphical representation of the density of posts across geographic locations (derived from geo-coded, geo-referenced, and geo-profiled information). Scraawl provides zoom in and out capability and the ability to toggle to the Location Map (a Basic Statistic) – here you can zoom to show the individual posts associated with locations.
4. How are influential users and hashtags computed?
Influence Discovery uses a ranking approach to compute normalized scores that represent the influence of users and hashtags in the social interaction graph. The scores of the top 10 most influential users/hashtags and impacts ratios (which represent the relative importance of the contributions of neighbors to the influence scores of a particular user/hashtag) are shown.
5. How are communities determined?
Community Detection uses a graph-theoretic approach to partition the social interaction graph into communities based on the level of interaction between nodes (users and hashtags). Scraawl provides community statistics including the number of communities, average community size, and maximum community size. Details of the top 10 communities and the most connected users/hashtags in these communities are shown.
6. How is the sentiment of a post computed?
Sentiment Analysis uses a machine learning-based approach that scores each record based on textual and structural features and then classifies them as positive, negative, or neutral. Classification accuracy is in the 75-80% range on average and may vary depending on the context of the conversations and on the language analyzed. Misclassifications can occur. Top posts representative of positive and negative sentiments are shown. Scraawl’s Sentiment Analysis works for 12 different languages (English, Turkish, Spanish, Russian, French, German, Italian, Polish, Portuguese, Indonesian, Tagalog, and Arabic).
7. How is Topic Modeling performed?
Topic Modeling uses a probabilistic model to discover patterns of word use within and across tweets. The model uses this information to identify up to eight abstract “topics” that occur in the collection. For each of the eight topics, a probabilistic score that represents the likelihood of the topic, and up to 15 top words within that topic are shown.
8. Why do I see 2-3 topics on some reports and more on others?
The number of topics shown is a function of the data that is collected. If your search criteria were broad, your data is likely to have more topics than if you had used a more focused set of search criteria.
9. What is the Media Gallery?
Media Gallery collects images and videos (You Tube, Vine, and Vimeo) contained in the posts, sorts them by frequency, and presents them in a visual gallery. Simply click any image to view more details. The media type can be filtered by a particular category using the Filter by Media Type pulldown.
10. How does Named Entity Recognition work?
Named Entity Recognition uses a statistical matching approach to identify named entities by applying fast search with various large-scale gazetteers. Named entities recognized by Scraawl include persons, locations, and organizations. Scraawl shows the top 50 named entities with their types, entity counts, user counts, and percentages.
11. What is Bot Detection?
Bot Detection uses various statistical, temporal, and textual features that are detected in social media posts and historical user profiles to distinguish potential bots from human users. Scraawl assigns a bot score to each user and then displays the top users with the most representative bot behavior. Using the Filter function, you can exclude posts associated with identified Bots from your report.
12. What is the Friendship Graph?
The Friendship Graph analytic allows a Scraawl user to search up to 5 Twitter handles for friend/follow relationships. For each handle, we provide up to 100 friends and 100 followers (https://developer.twitter.com/en/docs/accounts-and-users/follow-search-get-users/api-reference). Thus, the maximum number of handles (vertices in the graph) is 1000.
13. What is the difference between a Social Graph and a Friendship Graph?
Using the posts collected in your report, Scraawl constructs a Social Graph in which the nodes are the users and hashtags, and the connections are the interactions between them (e.g., retweet, use of a hashtag or mention of a user, etc.). A Friendship Graph on the other hand can be created for any user (even users not represented in your report) and shows up to 200 of the most recent friends and followers of the specified users. There are buttons to generate friendship graphs from the top users or top mentions from your report, or you can manually enter users.
14. In the Social Metrics, how are reach, engagement, and potential impressions defined?
Scraawl uses the following definitions for its social metrics. Engagement is the sum of all replies, retweets, mentions, and likes of brand’s posts over a reporting period. It is a reflection of the number of times a user interacted with the brand. A brand’s Reach is the sum of the followers of all unique users who mentioned or retweeted the brand during the reporting period, plus the number of followers of the brand over the reporting period. Potential Impressions is the sum of the reach of all posts mentioning or retweeting the brand over the reporting period. Potential Impressions is an estimate of the number of times a post that mentions the brand could show up in a user’s social media feed. When the reporting period is more than a day, the maximum follower count over the reporting period is used in the calculation.
15. Why don’t my reach, engagement, and potential impressions numbers match up with those on Twitter analytics?
Twitter uses slightly different definitions to calculate social metrics. In addition to including replies, retweets, and mentions, Twitter analytics includes hashtag clicks, link clicks, avatar clicks, username clicks, Tweet expansions, and follows. Similarly, Twitter analytics uses “actual impressions” as opposed to potential impressions. The definition used by Twitter’s new engagement API identifies an impression as “anytime a user sees your Tweet.”
16. How are Social Metrics defined in Scraawl for Facebook?
In Scraawl, for Facebook we use the following definitions of social metrics for public pages. Facebook fans is the number of Facebook users who liked the page (not posts). People Talking About is a trailing seven-day Facebook metric that measures how many people are “talking” (creating stories) about your page. Check-ins is the number of users who announced their location to their friends on Facebook by tapping a “check in” button to see a list of places nearby, and then chose the place that matches where they were. Engagement is the sum number of likes comments & shares of all downloaded posts in the report. For user-managed pages, Facebook Insight analytics can provide additional analytics related to consumptions (engagement), reach and impressions. Consumptions is the number of times users clicked (anywhere) on your page. This includes, Link Clicks, Photo Views, Video plays and Other Clicks (Likes comments shares etc). Reach is the number of unique people who have seen content associated with your page. Impressions are the number of times a post from your Page is displayed on a users timeline. People may see multiple impressions of the same post.
17. What's the difference between the timeline in Basic Statistics and the Timeline analytic in News Feed Advanced Analytics?
The Basic Statistics timeline shows the volume of search results over time. You can filter results using the timeline. In News Feed searches, the Document Timeline, shows the all the articles in this report in a chronological order. Each document group contains 20 documents and their published times are shown in the time line view. Users can scan through the articles in each group by swiping through the articles or using left and right arrows. Unlike the Basic Statistics timeline, the Advanced Analytic pulls in a featured image and links directly to the article.
18. What is Avatar Analytics?
Avatar Analytics uses face recognition (with machine learning) to identify similar avatars among the top 250 users in your report. Clicking on an avatar allows a user to drill down into the profiles of all similar avatars. Clicking on a particular profile, provides a further drill down into the posts by the user in the report.
19. Which analytics are geo-spatial, social network-, language-, image-, or behavior-based?
Scraawl’s integrated suite of Advanced Analytics leverage a variety of cutting-edge technologies that fall into the following categories:
Geo-spatial – Heat Map
Social Network – Social Graph, Friendship Graph, Influence Discovery, Community Detection
Natural Language Processing – Sentiment Analysis, Topic Modeling, Named Entities
Image processing – Media Gallery, Portrait Gallery, Avatar Analytics
Behavioral – Social Metrics, Bot Detection
20. What does the word score in Topic Modeling mean?
The word scores are not percentages of word frequency in a topic. Instead the word scores in Topic Modeling represent the contributions of words to a topics.
1. What is raw data?
The Raw Data tab shows all the posts in your report. Posts are displayed in chronological order with the most recent tweet displayed first. The posts are searchable using the supported operators for each feed (see the operators link in the search tip under the Search box).
2. How can I search and filter my data?
There are many ways to filter your data in Scraawl. (1) You can use the Timeline sliders on the Basic Statistics dashboard to focus on posts during a particular time period. (2) You can select and exclude posts associated with elements from any of the “Top” lists in Basic Statistics. (3) After drilling down on a particular element in a “Top” list, you can use the View All button to see the posts associated with the selected element. (4) You can use the geo-fencing feature on the Location Map to focus in on posts from a particular region – remember to select the relevant geo-type (geo-coded, geo-referenced, or geo-profiled). (5) You can search and filter the Raw Data.
3. Can I search and filter from my raw data?
Yes. You can use a number of search operators in raw data such as word-match, time, or username. You can also use Scraawl’s Sentiment, Community, and Topic analytics for search. You can create combinations of these analytic operators, layering and filtering as needed. A complete list of supported search expressions can be found by clicking on the operators link in the search tip under the Search box in Raw Data. Once you have found the desired posts using the search operators, you can choose to keep or exclude the posts using Keep ONLY matching or Exclude. You can also use the Bookmark feature and then Export Bookmarked posts (from Actions menu) to a Case Report.
4. Do I lose all the data that was excluded from my report?
No, the data is not lost. To revert to the original dataset, select Undo All Edits from the Actions pulldown.
5. What does bookmarking do?
Once you have searched and filtered your data, you may want to bookmark select posts for future reference or a separate analysis. The Bookmark menu provides options to bookmark or un-bookmark selected posts. You can Export Bookmarked posts (from Actions menu) to a Case Report. Case Reports then behave like any other report – you can view Basic Statistics, Advanced Analytics, and Raw Data.
1. What are the pricing plans for a Scraawl Personal, Professional, Premium, or Enterprise plan?
Please refer to the plans page or contact us for further pricing information.
More ResourcesMore Resources
Learn more about Scraawl with white papers and video tutorials---
Tracking Influencers during live events has never been easier. Find out how to here:
Interested in Bot Detection? Learn more here:
Who we are and what you can do with Scraawl: