Online social networks allow people to share news about their lives with friends, such as hobbies, vacations, events, their favorite foods or sports. This reflects the preferred lifestyles of individual users and collectively forms the “culture” of a society when there are commonly shared preferences by the members of a society.1

Such lifestyles, e.g., what we eat, what we wear, or what we do, are important and popular topics of user generated content in social media, especially in user photographs. Many people take photographs about their daily activities and events with their smartphones and post online to share with friends. The popularity of online visual sharing has greatly surged in recent years with a rapid growth of or shift to visual-centric online media. Therefore, by analyzing the photographs people post and their content, we will be able to tell their preferences on certain lifestyles and also understand how popular lifestyles evolve over space and time.

The primal goal of our paper is to understand the role of social media in the process of “culture sharing” which means the exchanges or mutual exposures of preferred lifestyles via social ties between users from different cultural backgrounds. For example, many users on Facebook have friends in other countries, who would post about their own local cuisines. The users will see these posts and photographs and may become interested in trying it. They can also make their own posts about their experience, which will be visible to their friends. This process is known as social influence.

How can we examine the flow of cultural preference from user posts? This problem is closely related to the topic of information or behavior diffusion in social networks (Gruhl et al. 2004; Adar and Adamic 2005; Cha, Mislove, and Gummadi 2009; Bakshy et al. 2012). These studies take advantage of shared network links or urls from different users as references or infer topics from text data. However, we are interested in detecting and comparing general lifestyles and preferences which are not specified by users but nonverbally depicted in the photographs, which necessitates visual content analysis.

To this end, our paper makes two main contributions by a scalable computer vision pipeline. Firstly, we study cultural trends in Facebook photographs from 2013 to 2016. To protect user privacy, all photos analyzed were deiden-tified and aggregated. We first define commonly observable visual concepts related to lifestyles to quantify content of photographs. With these categories, we automatically classify the photographs by a convolutional neural network (CNN). We present various dynamic trends of different cultural lifestyles and activities, which show seasonal, geographical, or global trends.

Secondly, we also investigate the role of the friendship network in cultural diffusion in user photographs. People from diverse cultural backgrounds use Facebook to connect with friends and family. Social interactions within social media such as an exposure to a friend’s photograph may make the user more likely to adopt a new preference and post similar photographs. In contrast to existing studies on behavior or information diffusion which rely on shared links or explicit annotations, we automatically classify visual content of photographs and compare the predicted scores. We first measure the social correlation of cultural lifestyles between friends. Then we further use advanced statistical tests to compare the effects between influence and homophily on the observed social correlation.

We summarize our key research questions as follows:

• Do Facebook photographs reflect the cultural preferences on lifestyles in different places and times?

• Social Correlation: Do friends in Facebook post more similar photographs than non-friends?

• Social Influence: Is the correlation, if any, due to homophily or influence?

Recent studies in computer vision have analyzed visual content from social media or web data but without considering network structures or content flow and diffusion. Likewise, studies in data mining or network analysis typically do not employ visual content analysis at massive scale. Our study bridges the gap between two areas of research.

Visual Recognition for Web and Social Media. Automated visual content analysis by computer vision has been used to analyze web images in various applications including fashion studies (Simo-Serra et al. 2015) or political analysis (Joo et al. 2014). Geo-tagged photographs are particularly useful to understand local communities and geographic differences in popular photographic style and content (Redi et al. 2016), architectural style (Doersch et al. 2012), natural environment (Wang, Korayem, and Crandall 2013), ecological phenomena (Zhang et al. 2012), or other socio-economic statues (Zhou et al. 2014; Salesses, Schechtner, and Hidalgo 2013; Ordonez and Berg 2014; Souza et al. 2015). These studies collect images for each geographical region and treat them collectively without distinguishing who post them (i.e., photos are used solely to study geographical features). In contrast, the key concern in this paper is each individual user’s social relation, and we study the role of social ties in cultural diffusion.

A few studies have also examined how image features can predict image popularity (Khosla, Das Sarma, and Hamid 2014; Totti et al. 2014) or viewer engagement (Bakhshi, Shamma, and Gilbert 2014). These studies focus on image instance-level analysis (i.e., “what makes this image popular?”) whereas our paper investigates whether certain visual concepts propagate between images of different users.

Diffusion in Social Networks. Social correlation and behavioral diffusion in social networks is another active research topic. Many studies have reported that behaviors or preferences of people can spread via social ties in social networks (Bond et al. 2012; Lewis, Gonzalez, and Kaufman 2012; Christakis and Fowler 2013; Aral and Walker 2011). For example, a longitudinal study (Lewis et al. 2008)

Table 1: A partial visual concept list in our analysis.

showed that online friends tend to share similar cultural tastes on movie, music, or books, but a subsequent analysis (Lewis, Gonzalez, and Kaufman 2012) revealed that these tastes are rarely contagious. These studies exploited user surveys or other attributes declared by users (e.g., profile information). In contrast, we infer the latent cultural preferences from user photographs.

Previous research has commonly identified three underlying factors driving social correlations: homophily (McPherson, Smith-Lovin, and Cook 2001), influence (Rogers 2010), and confounding factors. To distinguish the effects between homophily and influence from observational data, a handful of statistical tests have been proposed. Among them, we adopt the Shuffle test (Anagnostopoulos, Kumar, and Mahdian 2008) and the PME test (Sharma and Cosley 2016) because these are highly scalable to our large scale data than other methods (e.g., a simulation from a full joint state distribution (Snijders, Van de Bunt, and Steglich 2010)).

For our analysis, we use two groups of anonymized Facebook photographs. We did not use any user identifiable information. The social graph, friendship connections, was used in an aggregated form. The first set contains around 750 million de-identified photographs, sampled from the whole world in 2013-2016. Each photograph is associated with the photo upload time and the location of the owner.

The second set contains around 250 million de-identified photographs, sampled from 1.3 million users living in the same location. Since social correlation can be caused by confounding factors such as user attributes, we control for user gender, age group, and location (at city level) in this dataset. Such a treatment will not completely rule out all possible alternative explanations. However, we separate and isolate each user group by user attributes to minimize the effects from these confounding variables. We use a complete network of users in this area so that we can examine the photograph similarity between people who are friends as well as who are not friends to each other. We chose Seattle metropolitan area because it has a reasonably large but tractable number of users.

Visual Concepts We are interested in recognizing many different types of cultural lifestyles or activities in photographs. To quantify such lifestyles we first need to identify the list of visual concepts that our classifier can learn to recognize. From indefinitely many candidate classes encompassing various human activities, we select the most common concepts (K = 920) organized in a 2-layer hierarchical structure including the following 11 categories in Table 1. We provide the rationale and the full procedure to obtain the list as follows.

What do we mean by culture? As stated earlier, we focus on common human activities in our daily lives. Therefore, we paid our attention to the common concepts portrayed in user photographs and took a bottom-up approach to construct the whole list of concepts. Specifically, we randomly sampled about 100k photographs and asked annotators to describe the main visible concepts of images using a few keywords. The obtained responses ranged from objects (e.g., car or banana), actions or activities (e.g., climbing or jumping) to scene attributes or even famous places (e.g., Opera House). After pruning infrequent keywords, we manually examined the whole set of keywords to merge redundant or similar concepts.

We excluded keywords which are not strongly tied to apparent visual features or subjective expressions, such as ‘happy’ or ‘fantastic’ and potentially sensitive concepts (ethnicity, etc). However, we did not remove every concept which may not look directly relevant to “culture” such as ‘table’ or ‘grass.’ This is because such trivial objects still may indicate events (e.g., ‘picnic’), interests of users (e.g., ’home decoration’) or style (e.g., ‘selfie’); these are very important to capture. Given the final list of concepts, we manually group them into 11 semantic categories.

Model and Training We collected annotations to train our model by an iterative approach. Human annotators provided binary (yes/no) annotations for each concept given an image. We start by annotating relatively a small number of photographs and train an initial model. Then we apply the model back to random image samples to seek hard negatives and hard positives and retrain the model. This procedure is repeated until the model achieves a robust classification accuracy. The annotators were instructed to focus on main concepts and ignore concepts which are very small or not clearly visible. The trained model thus follows the same behavior.

We pose our problem as multiple binary classification instead of multiclass classification (1-out-of-K) such that our classes do not compete with each other. This also means that an image may have more than one concepts detected. See Figure 3 for example outputs of our model. The images were selected from a public image dataset for the privacy issue; but they resemble common images in Facebook.

To classify visual concepts from images, we use a deep residual network (ResNet-50) (He et al. 2016), which has shown the state-of-the-art performance for image classifi-cation. We train our model from scratch and take an iterative active learning approach as stated above. In addition, we replace the last softmax layer of the residual net for fi-nal classification with Sigmoid functions to perform multilabel classification. We crop the center region of an image and scale it to the canonical size of 224 by 224 pixels as in the standard practice. Each image takes around 200 ms to process in a single CPU. Our implementation is based on Torch. We follow most details and hyper-parameters speci-fied in the original paper; See (He et al. 2016) for the full details (github.com/facebook/fb.resnet.torch).

Concept Prediction Accuracy

Table 2 presents the performance of our train models measured by area-under-curve (AUC) in ROC curves. Due to the space limit, we only show the aggregated performance grouped by each category and the average ratio of positive examples. The performance was measured on a completely separate set of images with more than 7M annotations, which were not used in training.

Table 2: Accuracy of visual concept classification.

Spatio-Temporal Trends

Figure 1 shows the global popularities of various concepts measured from photographs posted from 2013 July and 2016 June. For each concept, we obtained an average score per country while ensuring each country has at least 100,000 images per year during this period. As seen in this figure, some concepts (e.g., basketball) are ubiquitous and gaining a global popularity while some other concepts (e.g., American football) are concentrated on specific regions.

As expected, many concepts reflect their actual spatial popularities (e.g., American Football or noodle). While we

Figure 1: Popular concepts in the sports and food categories across different countries, aggregated from July 2013 to June 2016. More red means a higher average score of photographs in that country for the concept. See the text for detail.

table smiling hug night

Figure 2: Three groups of visual concepts clustered by their temporal trends: (a) increasing, (b) decreasing, (c) seasonal variation. The y-axis represents the normalized concept popularity in the range .

Figure 3: Example images with top detected concepts and their scores. These images are not Facebook images but selected from a public dataset (Lin et al. 2014) for the purpose of displaying.

Figure 4: Temporal variations of visual concept popularities during a day in the UK.

do not have ground truth to verify the accuracy, we observe the result exhibits similar patterns with a public index (Hecht et al. 2012), which estimates the spatial relevance of concepts from Wikipedia data. However, not all concepts are strongly related to their origins or actual usage. For instance, the concept of ‘latte’ shows a relatively small correlation with the actual coffee consumption per capita data (r = .29, p < 0.001)2 where East Asian countries tend to post the concept more frequently than Scandinavian countries, who in fact consume much more coffee. This suggests people may post photographs selectively according to their preferences or local trends.

We also examine the temporal changes or trends of the visual concepts. Figure 2 shows three different patterns of trends: (a) increasing, (b) decreasing, (c) seasonal variation. We use dynamic time warping and K-means algorithm (K = 7 in this case; using a different K did not signifi-cantly affect the obtained main patterns.) to cluster concepts based on their normalized temporal evolutions. Many seasonal concepts reach their peaks at a particular season, either summer or winter, and are suppressed in other seasons. The length of such a cycle might be annual for seasonal concepts such as ocean or skiing or daily for certain concepts such as night or restaurant (Figure 4).

Lastly, we also present spatio-temporal co-evolutional visual trends. The popularities of some visual concepts change over time and location. The most common type of such pat-

Figure 5: The temporal variations of seasonal concepts are often opposite in the Northern hemisphere and the Southern hemisphere.

terns is again seasonal variation, where the Northern and the Southern hemisphere exhibit opposite patterns and alternate their status (i.e., active and inactive) on these concepts as shown in Figure 5.

Cultural Similarity between Countries

From the presented visualizations, we note that the popularities of visual concepts differ from one country to another and it reflects local cultural or geographical factors. To investigate to which degree this distribution can characterize various local cultures of each country, we examine whether countries from similar cultural backgrounds (e.g., Western or Asian) also exhibit similar patterns of popular visual concepts among their user photographs.

We first measure the similarity in cultural lifestyles in user photographs between countries. We estimate an average popularity of visual concepts for each country and use a cosine similarity between countries to obtain their visual similarities. To visually examine the inter-correlations between countries, we employ t-SNE (Maaten and Hinton 2008) to map the countries into a 2-D plane while maximally preserving their inter-similarities as shown in Figure 6. We use the same color for the countries in the same continental region.

Figure 6: A t-SNE embedding of countries from inter-country visual similarities measured at 2014 and 2015.

Table 3: Correlations between the visual similarity and socio-economic statues between countries (HDI: human development index).

We find that the countries from the same continent or from the similar cultural background (e.g., US and other European countries) are placed closely. The result indicates that the users’ photographs convey the cultural lifestyles within each country. We also note that the embedding of the same country at different years (2014 and 2015) are very close, which suggests that the temporal variations tend to be smaller than inter-country variations.

In addition, we examine whether the visual similarity is correlated with socio-economic or geographical factors such as language, geolocation, GDP, etc. We obtain the social variables of the studied countries from an independent operated website (http://www.aneki.com/comparison.php). To simplify the estimation, we assign a binary attribute value to each social variable for a country pair to indicate whether two countries fall into the same category (i.e., speak the same language or in the same continent). Then we measure individual Pearson’s correlation coefficients between the social variables and the visual similarities, as shown in Table 3. All the cultural or socio-economic attributes considered are correlated with the visual similarity although none of single attributes yields a particularly strong correlation. This suggests that there might be multiple underlying cultural factors shaping what people commonly post in social media.

Figure 7: The difference of social correlation between friends and non-friends groups (gender and age controlled for). The mean of the friend group is significantly larger than the non-friend group except Music. All statistically signifi-cant (p-val < 0.00001) except Music (p-val = 0.111).

Photograph similarity and friendship ties: Diffusion or Homophily?

We now turn our focus to the second set of our research questions on the photograph similarity among Facebook users and its relation to the social ties, i.e., friendship. Prior research has suggested that tied individuals in a social network more likely share common behaviors or actions. Two popular explanations are (1) people with similar preferences might tend to become friends more easily (homophily); and (2) behaviors might be diffused through the social ties from one friend to another (influence). Diffusion of culture, innovations, and ideas has long been considered as a core function of mass media such as TV or movies. We wish to examine whether the propagation of culture can be also facilitated in online social media space.

To rigorously measure the causal effect of this procedure typically requires a manipulative experimental design with randomized interventions. We limit our scope in this paper to a purely observational study which does not build on any artificial controls over user activities or news feed. Therefore we use several statistical tests which can be used to infer suggestive effects of the network structure to social correlation, instead of a definitive causal inference.

We used our second data collection (Seattle) for the analysis in the section to rule out the confound of user location. For example, people who live close to each other would be more likely friends and also post more similar photographs due to local factors such as climate, local events, or any other local cultures. Although the granularity of city level might be considered coarse to rule out geographical confound completely, this was the finest scope to which we had access. We further control for user age and gender in the following analysis when applicable. The dataset comprises 1.3 M users and 250 M photographs posted by them from 2013 to 2016.

Measuring similarity of users. We use different tests with slightly different ways of treating or counting visual concepts. Some prior studies considered individual discrete behaviors such as an adoption of a game (Aral, Muchnik, and Sundararajan 2009) or tagging a specific keyword (Anagnostopoulos, Kumar, and Mahdian 2008). In this case, an user’s behavior is a binary variable and the correlation is measured based on whether friends have the same be-

Figure 8: The difference in social correlation between friends and non-friends pairs. The results are separated by user age and age group.

haviors or not. We follow this way in the Shuffle test while treating each individual concept separately. There exist other studies which measure how similar their behaviors or the content they generate are (Sharma and Cosley 2016). We use this way as well in the PME test where we measure the visual similarity using all concepts and the following subsection of social correlation.

Social Correlation among Friends We first examine whether individuals linked with social ties (i.e., friends) post more similar photographs than people without direct ties.

Let’s denote by V the whole set of 1 M users and by E the set of edges (friendship ties) between them. For each friend pair , we randomly select another user such that (non-friend). Let’s denote the set of the tuples of selected users by T. Note that selecting needs to be done carefully because there might be external factors such as user’s gender which would affect both the likelihood of friendship and that of the visual similarity. To control for such confounding factors, we enforce to be of the same gender and age group as .

Let be the vector of average scores of the visual concepts in each category of the user . Then we measure cosine similarities of and . Finally the social correlation here is defined by the average difference between these two similarities such that

Figure 7 reports the difference of the social correlations between friend pairs and non-friend pairs across the 11 categories (Sec. Visual Concepts). We performed a t-test to see whether two groups are statistically distinct and found that the friend group has significantly larger correlations than the non-friend group across all categories except music. Figure 9 shows the differences of the average concept scores between friend and non-friend pairs for 4 different concepts.

We also investigate whether the degree of social correlation differs by demographic groups. Figure 8 summarizes the differences in social correlation between friend pairs and non-friend pairs, reported separately for each age group or gender. We note that the users in 30-49 age group show bigger differences in correlations in most categories while younger users (18-29) are more correlated with their friends in vehicles and clothes. On the other hand, friends of the

Figure 9: Social correlation: histograms of the difference of the average scores between friend and non-friend pairs for 4 visual concepts. The x-axis represents the score difference and the y-axis represents the number of pairs. The friend pairs are more similar in selfie, smile, and jeans, and two groups are similar in sunglasses (no correlation).

same gender are more correlated than non-friends of the same gender as well as friends of different genders, especially in Clothes and Sports.

Predictive Diffusion: Shuffle Test We now apply statistical tests proposed in recent papers to verify the effects of social influence in driving the observed social correlations. The Shuffle test (Anagnostopoulos, Kumar, and Mahdian 2008) is such a method to distinguish the source of the observed correlation. These methods compare social correlations between what is actually observed and what would have been observed if there had been no effects of social influence. These tests are not designed to infer a causal relationship and the term “influence” should be interpreted as predictive influence.

The procedure starts by fitting a logistic regression model with the original data and estimating a correlation parameter for each concept. Then the timestamps of user actions (i.e., photograph post times) are randomly permuted. We then estimate the model parameters on the permuted data and compare them with the original parameters.

Figure 10 shows the distributions of the correlation coef-ficient, . A higher means that the correlation is stronger and friends post more similar photographs. We can see this correlation is stronger in the original data before permutation. The mean values of all before the shuffle was 0.413 (SD = 0.123) and after the shuffle was 0.371 (SD = 0.143) with a t-test verifying the former is larger (t=4.538, p-val < 0.00001). This means that the sequence of actions of posting the same visual concept (of friends) is aligned with their friendship links. In other words, the decision of each user

Table 4: Top concepts with the largest changes in Shuffle test.

Table 5: Top concepts with the largest before Shuffle test

to post the concept or not is correlated with the number of friends who recently share the same concept. This might be due to (1) the increased likelihood for an exposure and/or (2) the social “threshold” required for one’s adaptation (Granovetter 1978). Therefore, this result can be suggestive of the influential role of social ties in the diffusion of such visual concepts as opposed to homophily.

Table 4 further reveals the top concepts that have the largest correlation changes, before and after the shuffle. These concepts are more sensitive to the timestamps of users’ behaviors, which suggests the correlation between friend users are more likely due to influence by their friends on these visual concepts. The concepts of ‘face’ or ‘person’ are not directly pertinent to culture; however, they can be highly indicative of other activities such as sports or group events. Also, Table 5 lists the concepts that have largest correlation coefficients, but are less sensitive to the timestamps of users’ behaviors. Therefore, these high correlations in these concepts are likely mainly driven by homophily. This result also suggests that a high correlation does not always mean a contagion.

Preference-based Matched Estimation Test We also use the Preference-based Matched Estimation (PME) test to distinguish the effects of influence and homophily (Sharma and Cosley 2016). Unlike the Shuffle test which operates on each individual visual concept, we now measure the overall similarity across all concepts. The PME was originally used to

Figure 10: (a) A scatter plot showing the correlation coeffi-cients estimated from original data (blue) and randomly permuted data (red). (b) Cumulative density functions of the coefficients. These show the correlation is stronger in the original data.

analyze the copy of a particular behavior. Thus, the temporal order matters in this type of analysis. However, in our experiments, we are interested in the implicit propagation of behaviors – the behavior of uploading a photo with similar content, and there are usually delays more than several days in similar posts. Therefore, our results are less sensitive to the perturbed temporal order introduced by Facebook’s feed ranking algorithm.

The PME test assumes that there is no social influence between non-friend users and estimates the effect of influence by replacing a friend of a user with a non-friend similar to the friend. Specifically, the PME test first tries to match each friend f of user u with a non-friend user s, who has similar preference with user f. In the next stage, it estimates the social influence by subtracting the correlation between non-friend pair s and u from the correlation between friend pair f and u. We use the following two criteria to match user f and s at time t. • User f and s should post images having similar set of

concepts. Following (Sharma and Cosley 2016), we use

Jaccard Index to compute the overlap between them:

where is the set of concepts of the images posted by user i before time t.

• The number of concepts of f and the number of concepts of s should also be similar. We define it as

We choose J(f, s) > 0.9 and N(f, s) < 0.1 in our implementation. Next, the influence is estimated as the difference of the correlation between u and his friend f, and the correlation between u and his non-friend s:

Table 6: Results of the PME test

where F(u) is set of friend users of u and S(u) is the matched non-friend users, and are the set of concepts in the images posted by the group of users F(u) and S(u) from time t+1 respectively, and is the set of concepts for user u from time t+1. We choose a timestamp t in 2015/05, a year earlier from the latest time in our dataset. Next, we compute the concept set of images posted by user u in the past half year before 2015/05 and the concept set as the past half year before 2016/05.

Table 6 shows the result of the PME test. Overall, we found that there exists an effect of social influence among user photographs. Although the variation across users tends to be large, the t-test verifies its statistical significance. This result also confirms that the effect can be found when considering all concepts together.

We have shown that automated classification of visual content of photographs in social media is an effective means to assess the local and global trends of various cultural activities and lifestyles, depicted in user photographs in Facebook. We have built a scalable computational pipeline to process Facebook photographs and analyze various spatio-temporal patterns as well as its diffusion pattern via social ties. We specifically focus on understanding how people communicate and interact visually and did not use common features such as user texts or hashtags. The visual cues do not require any translation between countries speaking different languages, thus our analysis seamlessly applies across many different regions and cultures universally. Overall, our analysis suggests two important findings as follows.

Firstly, user photographs in Facebook display a variety of cultural lifestyles and preferences on many categories such as sports, food, fashion, etc. Inferring human activities from photographs is thus an effective way of understanding popular activities or preferences at specific places and times. The granularity of analysis is very fine as exemplified in our analysis during a day (Fig. 4) since many people tend to post photographs in real time. We also match different photographs showing the same activity or concept by content analysis. Therefore our approach is more advantageous for understanding global spreads of cultural preferences than methods based on shared links or urls.

Secondly, the cultural lifestyles in user photographs tend to be more similar between friend pairs than non-friends pairs, a phenomenon known as social correlation (Anagnostopoulos, Kumar, and Mahdian 2008). We are not aware of any previous work which attempts to measure the user similarity between tied individuals in social media by automatically analyzing visual content. Although some studies have examined how Facebook profile photographs are correlated with user attributes such as race (Huang and Park 2013) or gender (Hum et al. 2011), these works did not investigate the role of network ties or any individual level’s diffusion.

One important question is whether such a correlation is an outcome of social interaction (influence or induction) or simply an artifact due to homophily (Anagnostopoulos, Kumar, and Mahdian 2008; Sharma and Cosley 2016). Although we are unable to fully verify the causal relationship in our observational study, we found several evidences and indicators showing the possibility of an effect of social in-fluence.

Our result is in contrast to the study by Sharma and Cosley (2016) who have proposed and applied the PME test on data from Flickr, Flixster, Last.fm, and Goodreads, and reported that the effect of influence is very small. By applying the same method, we found the effect of predictive influence is significant. We conjecture that this inconsistency could be caused by the fact that Facebook is a more friendshiporiented medium (i.e., most content come from friends) than the others studied in (Sharma and Cosley 2016).

Limits and significance of the current study

There are limitations in our paper. Firstly, we assume that an user would be exposed to each photograph of each of his/her friends with an identical and fixed probability. However, there exist several factors (e.g., the number of comments) that can govern the post recommendation, which might signify the effects of more popular photographs. This was also considered as a potential weakness in the original PTE test (Sharma and Cosley 2016). We leave it to the future work to investigate the effects of more “popular” content, which may have a higher chance of correlation or influence.

Secondly, we did not consider non-visual cues (e.g., text or urls), which may also have interesting relations to cultural diffusion. The main reasons are, as stated earlier, i) we are interested in the effect of the visual cue and its content which was not studied before and ii) photographs are global and ubiquitous while text or urls are usually language dependent and/or specific to local regions or sub-populations, which may limit the scope of study to certain local cultures.

Finally, our analysis was based on observational data and thus we cannot rule out all possible confounding factors. This is a common issue for research where manipulations or random treatment are not possible (Shalizi and Thomas 2011). However, we controlled for user age, gender, and location and used predictive statistical tests to account for the effect of homophily. While the results are not causal, our findings are novel and significant due to following reasons: i) a correlational link on photographic similarities between massive social media users was first shown to exist by our analysis; ii) many prior studies utilizing the same statistical test (Anagnostopoulos, Kumar, and Mahdian 2008; Sharma and Cosley 2016) did not find the effect of influ-ence (vs. homophily) in social networks, however, we found the effect using a novel cue. That effect was not found in a causal relation but obtained after eliminating correlations from shared user attributes and homophily. Therefore our findings strongly demonstrate the saliency of visual cues which have been overlooked in prior studies.

Reproducibility: We provided the exact procedures for our analysis. A code to train the same model that we used is publicly available and we elaborated our modifications in full detail. While our method is reproducible, the data is not publicly available. Nevertheless, our study and procedure can apply to any social media with visual content shared by users in a social network.

Adar, E., and Adamic, L. A. 2005. Tracking information epidemics in blogspace. In Proceedings of the 2005 IEEE/WIC/ACM international conference on web intelligence.

Anagnostopoulos, A.; Kumar, R.; and Mahdian, M. 2008. In-fluence and correlation in social networks. In ACM SIGKDD.

Aral, S., and Walker, D. 2011. Creating social contagion through viral product design: A randomized trial of peer influ-ence in networks. Management science 57(9):1623–1639.

Aral, S.; Muchnik, L.; and Sundararajan, A. 2009. Distinguishing influence-based contagion from homophily-driven diffusion in dynamic networks. Proceedings of the National Academy of Sciences 106(51):21544–21549.

Bakhshi, S.; Shamma, D. A.; and Gilbert, E. 2014. Faces engage us: Photos with faces attract more likes and comments on instagram. In ACM CHI.

Bakshy, E.; Rosenn, I.; Marlow, C.; and Adamic, L. 2012. The role of social networks in information diffusion. In WWW.

Bond, R. M.; Fariss, C. J.; Jones, J. J.; Kramer, A. D.; Marlow, C.; Settle, J. E.; and Fowler, J. H. 2012. A 61-million-person experiment in social influence and political mobilization. Nature 489(7415):295–298.

Cha, M.; Mislove, A.; and Gummadi, K. P. 2009. A measurement-driven analysis of information propagation in the flickr social network. In Proc. of WWW.

Christakis, N. A., and Fowler, J. H. 2013. Social contagion theory: examining dynamic social networks and human behavior. Statistics in medicine 32(4):556–577.

Doersch, C.; Singh, S.; Gupta, A.; Sivic, J.; and Efros, A. 2012. What makes paris look like paris? ACM Transactions on Graphics 31(4).

Granovetter, M. 1978. Threshold models of collective behavior. American journal of sociology 83(6):1420–1443.

Gruhl, D.; Guha, R.; Liben-Nowell, D.; and Tomkins, A. 2004. Information diffusion through blogspace. In Proc. of WWW.

He, K.; Zhang, X.; Ren, S.; and Sun, J. 2016. Deep residual learning for image recognition. In CVPR.

Hecht, B.; Carton, S. H.; Quaderi, M.; Sch¨oning, J.; Raubal, M.; Gergle, D.; and Downey, D. 2012. Explanatory semantic relatedness and explicit spatialization for exploratory search. In SIGIR.

Huang, C.-M., and Park, D. 2013. Cultural influences on facebook photographs. International Journal of Psychology 48(3):334–343.

Hum, N. J.; Chamberlin, P. E.; Hambright, B. L.; Portwood, A. C.; Schat, A. C.; and Bevan, J. L. 2011. A picture is worth a thousand words: A content analysis of facebook profile photographs. Computers in Human Behavior 27(5).

Joo, J.; Li, W.; Steen, F. F.; and Zhu, S.-C. 2014. Visual persuasion: Inferring communicative intents of images. In CVPR. Khosla, A.; Das Sarma, A.; and Hamid, R. 2014. What makes an image popular? In WWW.

Kroeber, A. L., and Kluckhohn, C. 1952. Culture: A critical review of concepts and definitions. Papers. Peabody Museum of Archaeology & Ethnology, Harvard University.

Lewis, K.; Kaufman, J.; Gonzalez, M.; Wimmer, A.; and Christakis, N. 2008. Tastes, ties, and time: A new social network dataset using facebook. com. Social networks 30(4):330–342.

Lewis, K.; Gonzalez, M.; and Kaufman, J. 2012. Social selection and peer influence in an online social network. Proceedings of the National Academy of Sciences 109(1):68–72.

Lin, T.-Y.; Maire, M.; Belongie, S.; Hays, J.; Perona, P.; Ramanan, D.; Doll´ar, P.; and Zitnick, C. L. 2014. Microsoft coco: Common objects in context. In ECCV.

Maaten, L. v. d., and Hinton, G. 2008. Visualizing data using t-sne. Journal of Machine Learning Research 9(Nov).

McPherson, M.; Smith-Lovin, L.; and Cook, J. M. 2001. Birds of a feather: Homophily in social networks. Annual review of sociology 415–444.

Ordonez, V., and Berg, T. L. 2014. Learning high-level judgments of urban perception. In ECCV.

Redi, M.; Crockett, D.; Manovich, L.; and Osindero, S. 2016. What makes photo cultures different? In Proceedings of the 2016 ACM on Multimedia Conference, 287–291. ACM.

Rogers, E. M. 2010. Diffusion of innovations. Simon and Schuster.

Salesses, P.; Schechtner, K.; and Hidalgo, C. A. 2013. The collaborative image of the city: mapping the inequality of urban perception. PloS one 8(7).

Shalizi, C. R., and Thomas, A. C. 2011. Homophily and contagion are generically confounded in observational social network studies. Sociological methods & research 40(2):211–239. Sharma, A., and Cosley, D. 2016. Distinguishing between personal preferences and social influence in online activity feeds. In CSCW.

Simo-Serra, E.; Fidler, S.; Moreno-Noguer, F.; and Urtasun, R. 2015. Neuroaesthetics in fashion: Modeling the perception of fashionability. In CVPR.

Snijders, T. A.; Van de Bunt, G. G.; and Steglich, C. E. 2010. Introduction to stochastic actor-based models for network dynamics. Social networks 32(1):44–60.

Souza, F.; de Las Casas, D.; Flores, V.; Youn, S.; Cha, M.; Quercia, D.; and Almeida, V. 2015. Dawn of the selfie era: The whos, wheres, and hows of selfies on instagram. In COSN.

Totti, L. C.; Costa, F. A.; Avila, S.; Valle, E.; Meira Jr, W.; and Almeida, V. 2014. The impact of visual attributes on online image diffusion. In ACM Conference on Web science.

Wang, J.; Korayem, M.; and Crandall, D. 2013. Observing the natural world with flickr. In ICCVW.

Zhang, H.; Korayem, M.; Crandall, D. J.; and LeBuhn, G. 2012. Mining photo-sharing websites to study ecological phenomena. In WWW.

Zhou, B.; Liu, L.; Oliva, A.; and Torralba, A. 2014. Recognizing city identity via attribute analysis of geo-tagged images. In ECCV.