Data Mining of Chinese Social Media
| dc.contributor.advisor | Wallach, Daniel S. | |
| dc.contributor.committeeMember | Jermaine, Christopher M | |
| dc.contributor.committeeMember | Bronk, Chris | |
| dc.creator | Shu, Anhei | |
| dc.date.accessioned | 2016-01-25T21:29:03Z | |
| dc.date.available | 2016-01-25T21:29:03Z | |
| dc.date.created | 2014-12 | |
| dc.date.issued | 2014-10-31 | |
| dc.date.submitted | December 2014 | |
| dc.date.updated | 2016-01-25T21:29:03Z | |
| dc.description.abstract | We present measurements and analysis of censorship on Weibo, a popular microblogging site in China. Since we were limited in the rate at which we could download posts, we identified users likely to participate in sensitive topics and recursively followed their social contacts, biasing our search toward a subset of Weibo where we hoped to be more likely to observe censorship. Our architecture enables us to detect post deletions within one minute of the deletion event, giving us a high-fidelity view of what is being deleted by the censors and when. We found that deletions happen most heavily in the first hour after a post has been submitted. Focusing on original posts, not reposts/retweets, we observed that nearly 30% of the total deletion events occur within 5-30 minutes. Nearly 90% of the deletions happen within the first 24 hours. Leveraging our data, we also consider a variety of hypotheses about the mechanisms used by Weibo for censorship, such as the extent to which they use retrospective keyword-based censorship, and how repost/retweet popularity interacts with censorship. By leveraging natural language processing techniques we also perform a topical analysis of the deleted posts, overcoming the usage of neologisms, named entities, and informal language that typifies Chinese social media. Using Independent Component Analysis, we find that the topics where mass removal happens the fastest are those that combine events that are hot topics in Weibo as a whole (e.g., the Beijing rainstorms or a sex scandal) with themes common to sensitive posts (e.g., Beijing, government, China, and policeman). Air pollution is a pressing concern for industrialized countries. Air quality measurements and their interpretations often take on political overtones. Similar concerns reflect the our understanding of what levels of measured pollution correspond to different levels of human nuisance, impairment, or injury. In this paper, we consider air pollution metrics from four large Chinese cities (U.S. embassy/consulate data, and Chinese domestic measurements) and compare them to a large volume of discussions on Weibo (a popular Chinese microblogging system). In the city with the worst PM2.5, Beijing, we found a strong correlation (R=0.82) between Chinese use of pollution-related terms and the ambient pollution. In other Chinese cities with lower pollution, the correlation was weaker. Nonetheless, our results show that social media may be a valuable proxy measurement for pollution, which may be quite valuable when traditional measurement stations are unavailable (or whose output is censored or misreported). | |
| dc.format.mimetype | application/pdf | |
| dc.identifier.citation | Shu, Anhei. "Data Mining of Chinese Social Media." (2014) Diss., Rice University. <a href="https://hdl.handle.net/1911/88119">https://hdl.handle.net/1911/88119</a>. | |
| dc.identifier.uri | https://hdl.handle.net/1911/88119 | |
| dc.language.iso | eng | |
| dc.rights | Copyright is held by the author, unless otherwise indicated. Permission to reuse, publish, or reproduce the work beyond the bounds of fair use or other exemptions to copyright law must be obtained from the copyright holder. | |
| dc.subject | Social network | |
| dc.subject | microblog | |
| dc.subject | data mining | |
| dc.subject | topic extraction | |
| dc.subject | censorship | |
| dc.title | Data Mining of Chinese Social Media | |
| dc.type | Thesis | |
| dc.type.material | Text | |
| thesis.degree.department | Computer Science | |
| thesis.degree.discipline | Engineering | |
| thesis.degree.grantor | Rice University | |
| thesis.degree.level | Doctoral | |
| thesis.degree.name | Doctor of Philosophy |
Files
Original bundle
1 - 1 of 1