Several reviews have been written about machine consciousness [24] [50] [25] that try to sum up all the ideas that literature has proposed about the potential arisal of consciousness in machines [14]. These ideas come from different areas such as artificial intelligence [13], neuroscience [46] or philosophy [53]. Although consciousness can not be measured directly, there exist approaches that have provided potential measures of consciousness in machines [4] [49].
Although the field generates controversy [16] as it lies in the margin of the scientific method, it has recently attracted the attention of relevant researchers of computer science such as Yoshua Bengio, who has provided an approach for how machine consciousness may arise with deep learning [10]. As deep learning [40] has generated machines that implement attention mechanisms [32], a new focus have emerged with the field of machine consciousness based in the astonishing hypothesis [16] that our intelligence and consciousness may arise from very simple principles.
Computational approaches for machine consciousness are based in the functionalism theory of consciousness [50]. This theory claims that while mental states correspond to brain states, they are mental states due to their functionality, not due to their physical composition. Hence, consciousness may appear in machines that implement behaviors observed in humans that are correlated with consciousness.
Throughout the recent years, there has been amazing advances in the arti-ficial intelligence and machine learning community [45] that does not only include deep learning models. In the machine consciousness literature, it has been hypothesized that consciousness, or phenomenal states [41], may arise from machines that are able to perform tasks that humans are able to do when they are conscious [17] [25]. This is based in the hypothesis that if humans are conscious when producing complex behaviours, then, machines may be conscious when they produce them too [23].
We know, and have measured, that humans are conscious when performing these behaviours thanks to functional magnetic resonance imaging (fMRI) and related techniques [34] [36]. These behaviours can include imagination [59], emotions [55], language communication and social relations [54] or awareness of the environment [37].
Machine learning recent models are able to generate art [21] that deviate from what they are fed to learn, are able to learn how to learn [60], learn from a few examples [56] and are able to transfer knowledge from a different task to behave better in a new one [35]. The applications of these abilities include natural language generation [20], understanding emotions [11] or generating videos [65]. We believe that if the philosophical theory that consciousness arises as a flux of information in any machine [52] is true, if we create a cognitive architecture [12] that is able to produce as many behaviours as possible that are correlated with consciousness in humans, then, the machine may as well arise, up to some extent, consciousness or phenomenal states.
We attempt to provide a bridge between the machine learning and the machine consciousness communities by providing the design of a cognitive architecture with machine consciousness behaviours through machine learning models. Several architectures have been proposed before [18] but none of them include both deep learning, generative processes and gaussian processes to generate interior cognitive processes and exterior behaviour and content. Section 2 will discuss related work. Then, in Section 3, we provide a detailed explanation of the modules of our architecture. Section 4 then provides the architecture that unifies these modules. We conclude our work with a section of conclusions and further work.
Due to different theories explaining the origin of consciousness, several approaches have been proposed to tackle this problem. We first discuss the different processes involving machine consciousness [24] and then, the different approaches that have tackled machine consciousness [50].
Machine consciousness processes involve mainly four categories ordered from 1 to 4 in function of how close to generating real awareness they are [25].
Level 1 includes machines that implements external behaviour associated with consciousness. Some of the described behaviours in the introduction section like social interactions implemented in machines would be level 1 and the field of artificial general intelligence [30] lies in this level. Several authors [33] [43] argue that machines implementing these behaviours may produce consciousness, but there is controversy. Machines that implement cognitive characteristics like imagination [3], attention, emotion, depiction and planning are level 2 machines. When an architecture involving all these process exists, we are talking about level 3 machines, that is, machines with an architecture that is claimed to be a cause or correlate of human consciousness. Lastly, phenomenally conscious machines are level 4 machines based in the hypothesis that several level 2-3 design could emerge phenomenal states [2].
Several approaches have tackled the previous categories of machine consciousness. A classification of them all [50] includes five categories: First one are methods based in the global workspace theory [5]. According to this theory, consciousness emerges from a system, like the brain, with a collection of distributed specialized networks with a fleeting memory capacity whose focal contents are widely distributed to many unconscious specialized networks, called contexts. These contexts work together to jointly constrain conscious events and to shape conscious contents [6]. These theory has support of the neuroscience community [7] and the computer science community [10]. We are also inspired by this theory to provide a cognitive architecture [12] with machine learning techniques. Other categories include methods that suggest that consciousness emerges from a certain amount of information processing and integration [9], from creating an internal self-model [47], from generating higher-level representations [1] and from attention mechanisms [38].
Machine consciousness has risen as a research topic for the deep learning literature [10], where the interest resides in learning representations of high-level concepts of the kind humans manipulate with language. We suggest that machine learning and related techniques [8] are able to work as a global workspace, process a high amount of information, can generate internal self-models and higher level representations and have attention mechanisms. Hence, machine learning and generative processes should be explored in this field.
We now provide the module design that implement cognitive processes and exhibit external behaviour that is correlated with consciousness [25]. In the selection of the cognitive processes to be simulated, we consider behaviors that can make an autonomous agent evolve to adapt to an unknown environment through observation and social interaction. These behaviours are also affected by processes that establish emotional connections between observed and imagined content (e.g., images generated by simulated dreams, emotion simulation, depiction of the environment) and that can be supported by novel techniques such as deep learning and generative methods.
3.1 Simulating dreams
In order to simulate dreams, we first have to record photos when being awake and store them in a semantic network [58]. Then, dreams will use that information
to generate a sequence of images
. We define a dream as a function d that converts a subset of a sequence of images
and a subset of a sequence of style images
in a new set of images D, that is D = d(P, S). In order to generate this procedure, we propose two processes for this simulator:
First, we classify images P into a semantic network R. We assume that a previous categorized semantic network R exists and that a robot has already learned to classify images P into that network R. An implementation of this process can have ImageNet [19] as semantic network. ImageNet is a resource with more than 14.000.000 images D(X) and more than 21.000 categories y. ImageNet uses the hierarchy of WordNet [22] to classify photos, having each category a semantic meaning and being organized as a graph G = V, E that can be traversed, where
is the node representing category
. Convolutional neural networks [39] or advanced neural models as Efficient Net L2 [64] or ResNet [63] neural models can classify photos into ImageNet. Let NN be the neural model that implements the robot, the robot will classify each input image P to category
, inserting it in the graph G through the NN trained on the ImageNet dataset D(X, y), that is:
)).
To feed images in the neural model NN to be classified in the graph G, we need a robot with an integrated camara to take the photos P and define a period of being awake and asleep
. These parameters can be configured differently for every robot. We suggest to save additional images S that will represent different styles seen like for example dark places or broad landscapes in a different semantic network
.
Second, we need to define the dreaming state given by time . We suggest to use a random walk [51] like the one performed in the Metropolis Hastings algorithm [15] to simulate movement into the semantic networks of images R and styles
that are related by semantic distance
) in their graphs
given by the number of edges that connect each category. At each step, we select two images
and invoke Deep Style neural networks [44] to generate a new image with the selected photo and an style applied
). Models such as a Generative Adversarial Network [48] can be used. The robot will then attend the photo and save it. We can observe examples of generated photos using the Deep Dream Generator by this procedure in Figure 1.
Fig. 1. Generated photos representing dreams by the Deep Dream Generator models (http://deepdreamgenerator.com/)
Initial categories are chosen randomly. To select the new cate- gories, we perform a random walk in the graph G and
given by some uniform distribution with a lower
and upper
limit, whose sampled value we will call step size
. If we set those parameters to a high number, dreams will contain different concepts and viceversa. We repeat the mentioned process by performing an iteration of the random walk. We store each generated image
. The sequence of recreated images D recreates the dream. After dreaming, the robot will be awake, iterating both processes.
3.2 Depiction. Being aware of the environment
We suggest to implement a robot that moves autonomously in a given environment E. For the sake of simplicity we are going to assume that E is 2-dimensional . This robot will remember the images D that has previously dreamed as described in the previous module. The robot, when awake, will try to return to the location or neighbourhood
where the images that has dreamed are located.
We will generate a 2-dimensional function of location importance with a sample from a Gaussian Process [62] over the environment E , discretized by a grid, for each robot r with interesting places to visit. We can observe examples of such functions at Figure 2 The resolution of the grid
can set the size of the environment E. Gaussian Processes models are flexible priors or distributions over functions where inference takes place directly in the functional space F. This functional space contains every possible environment that can be created
. The generated environment by the GP
will contain high-valued locations of interest to take photos from and viceversa. When the robot reaches these places, it will take photos of the environment and save them for the dream module. Once visited, these places will be penalized by a local penalization procedure [31]. These kind of procedures get a neighbourhood
centered in the place of interest
and penalizes this zone by, for example, a multivariate gaussian distribution
) =
).
The robot will end navigation when it is exhausted after its time awake . We can simulate fatigue through a non deterministic function
[0, 1] of time since it has last slept. Each time that the robot takes a photo, fatigue will be incremented or decremented depending on the reward given by the photo.
Fig. 2. Sampled functions from a 2-dimensional GP representing the importance value of each location of the environment for the robots.
We can assign a threshold [0, 1] for fatigue. When the robot is awake the threshold takes value 0 and it is incremented as a function of time or by
when taking a photo. The robot will fall asleep after the maximum time awake or if the non deterministic function samples a value higher than the threshold
. The action of taking or not the photo
in each place g of the grid will be non deterministic and dependant on the value of
, that is
). The robot can take a photo my sampling
periodically after an amount of steps s in
Specific parametric functions can be configured for each robot.
The Gaussian process sample will be contaminated by i.i.d. gaussian noise
) in each position of the grid g and dimension j in the period of being awake to favour exploration. Higher values of
will enforce exploration. The robot will navigate through the environment with a metaheuristic [61] (exploration-exploitation) or by the gradients of the Gaussian process [57] (exploitation). Random rewards will be put in the scenario.
3.3 Emotion simulation
In this section, we define a process that models emotions through objective functions [0, 1] of time. The main reason why we implement emotions in these robots is because they are going to influence the Gaussian Process prior
of the environment E. If the robots feels confident and happy
1, unknown near areas of E to the position of the robot g will be rewarded to be explored. If R is a neighbourhood of
containing a reward, we can reward its value by sampling from a multivariate gaussian distribution centered in the reward
) =
). By doing this process, the robot will enter a positive cycle and take photos of interesting places. By performing this action, we increment
) by a uniform distribution which limits [l, u] can be parametrized. If, in contrast, the robot feels sad and fear
0, movement across the grid will be penalized by incrementing fatigue and decrementing the step size
of the random walk, entering a negative loop.
These cognitive processes will exhibit external behaviour that will show if a robot is happy or sad by its activity on the grid. We provide an exit of the cycles by images of dreams D. Dreams can also influence emotions e(t) and make the robot behave differently. If an image resembles a visited area that had got high value of , happiness will be incremented by a parametrizable amount e(t) =
1) +
], where t represents time. If images of places with low value of
are displayed, the opposite operation will be performed e(t) =
1)
]. Happiness could also affect the fatigue function, by alleviating it if the robot is happy or increasing it in the other case.
Other emotions that may be optimized are curiosity and boredom [0, 1], that would affect the Gaussian Process sampled function
by penalizing already saw places by an MV G(0, I) and rewarding unknown places also by an MV G(0, I). A last example can be friendship and solitude
), based in relations with other robots that are going to be described further or courage and fear
) that will condition the movements across the environment by incrementing the step size
of the random walk. The described fatigue function can also be seen as an emotion. Particular parametric forms of the functions are open for the robot developer to be implemented.
3.4 Social relationships with other robots
If we want to simulate emotions e(t) like the ones felt with humans to show behaviour correlated with consciousness, we need to model these emotions to be not only a function of the environment interaction but also of relationships with other robots. For this reason, we consider that an essential component for the cognitive processes of the robots must be the interaction with other robots to share experiences, in the form of photos P in this setting, and influence the emotions e(t).
Emotions like friendship or solitude ) are dependant on social interactions. We define here a social interaction
) as the change of a photo
of a robot
with a photo
of a robot
when both robots share the same location g in the environment E. Each robot
has a different function sampled from the GP prior
of the environment E. As each photo
related to a position of the grid
, it will have, for every robot
a different value
(
), conditioning the rest of the emotions. If the photo refers to a location that the robot likes according to its prior
, emotions will make the robot more active. Although, if this is not the case, the robot may enter a negative cycle.
By interacting with each other, robots will share images P or dreamed images D of the environment E that will modify their Gaussian Process sampled function
and the other emotions of the robot. Specific parametric forms are again free for the programmer of the robot to be set.
In the previous section, we have described how can we implement behaviours correlated with consciousness in machines. All the described processes can be
implemented in a certain amount of robots with an environment E that they can traverse and get photos P from. In this section, we provide a diagram with all the modules described to illustrate how the information flows in our architecture. Besides the processes described in the previous section and in order to be more general, the proposed architecture uses multimodal information (e.g., ambient music and texts in form of recipes, besides images). These processes would generate subjective creations, which can be correlated with their communication to processes generated in conscious states, such as recipe suggestions [26] where in each position modelled by the GP the robot would find, with a probability sampled from a random variable, a suggestion of a recipe and generate in base of the recipe a degree of tastiness. Another alternative is to include ambient music simulations [42], where in each position in the input space we would have an ambient noise sample, also with a probability distribution given by the sampling of a random variable, and the robot would have a ambient music simulator, that uses these samples to generate music, simulating imagination and conditioning the emotion simulator. All these processes generate the architecture that we can see in Figure 3. We can observe how robots share images and other information showing so-
Fig. 3. Architecture of the proposed robots with behaviours correlated with conscious- ness. External processes that interact with the environment involve the depiction engine and the interface that collects data. Internal processes involve the dream, music and recipe generators and the emotion simulator, that condition the external behaviour. The hyperparameters of the robots models can be jointly optimized by a metaheuristic.
cial behaviour. These interactions affect their emotions and incur in a differ-ent movement across the environment, reflecting emotions, commonly correlated with consciousness. Cognitive interior processes include dreaming images that are function of the perceived images and simulating music and cooking recipes, affecting emotions. These behaviours could, according to the cited theories, be a correlation of consciousness in robots.
Lastly, we propose the optimization of the different parametric forms e(t) of the emotion engine and the parameters of the deep neural network for the dream simulation and the gaussian process for the environment in several simulations of the robots with a metaheuristic such as a genetic algorithm with the fitness being a function of the maximum number of interactions possible of the robots constrained to the maximum movement of the robots. By performing this optimization, we would end up having the optimum configuration for the robots to exhibit social behaviour, typically correlated with consciousness.
If the hyperparameters of the models are correctly optimized in future experiments, the outputs of these robots are hypothesized to be beautiful pieces of art in the form of pictures, music songs and cooking recipes, as all the environment can be seen as a reinforcement learning optimization technique to create subjective content and social interactions with conscious behaviours. Other architectures for machine consciousness just focus in cognitive processes and implementation of cited machine consciousness theories.
We have described an architecture of processes that, if implemented in robots, exhibit external behaviour in the form of genuine art content and social behaviour. According to machine consciousness theory [25], both characteristics could be correlated with machine consciousness in robots [24]. A significant novelty of this approach is the use of generative models based on the latest techniques of machine learning and deep learning to simulate processes such as imagination or depiction, where gaussian processes are flexible models that create functional spaces that contains lots of different environments.
The presented architecture is a theoretical proposal that should be validated with practical tests. For this reason, we plan to implement all the processes in robots to get empirical evidence about the behaviour associated with consciousness and execute machine consciousness tests with natural language processing modules to verify if the robots are able to pass them. Further work will also include optimizing the emotions by some mechanism such as constrained Multiobjective Bayesian Optimization [27] in order to create a global and dynamical policy for the behaviour of the robots and including a weighted causal graph [29] as knowledge base to generate more complex social relationships where even fake information could be shared or detected [28].
The authors acknowledge the use of the facilities of Centro de Computaci´on Cient´ıfica (CCC) at UAM and acknowledge financial support from Spanish Plan Nacional I+D+i, grants TIN2016-76406-P and TEC2016-81900-REDT.
1. Aleksander, I. Impossible minds: my neurons, my consciousness. World Scien-tific, 1996.
2. Aleksander, I. Why axiomatic models of being conscious? Journal of Consciousness Studies 14, 7 (2007), 15–27.
3. Aleksander, I., and Dunmall, B. Axioms and tests for the presence of minimal consciousness in agents i: preamble. Journal of Consciousness Studies 10, 4-5 (2003), 7–18.
4. Arrabales, R., Ledezma, A., and Sanchis, A. Consscale: A pragmatic scale for measuring the level of consciousness in artificial agents. Journal of Consciousness Studies 17, 3-4 (2010), 131–164.
5. Baars, B. J. In the theatre of consciousness. global workspace theory, a rigorous scientific theory of consciousness. Journal of Consciousness Studies 4, 4 (1997), 292–309.
6. Baars, B. J. The global workspace theory of consciousness. The Blackwell companion to consciousness (2007), 236–246.
7. Baars, B. J., and Newman, J. A neurobiological interpretation of global workspace theory. Consciousness in philosophy and cognitive neuroscience (1994), 211–226.
8. Bahdanau, D., Cho, K., and Bengio, Y. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 (2014).
9. Balduzzi, D., and Tononi, G. Integrated information in discrete dynamical systems: motivation and theoretical framework. PLoS computational biology 4, 6 (2008).
10. Bengio, Y. The consciousness prior. arXiv preprint arXiv:1709.08568 (2017).
11. Cambria, E. Affective computing and sentiment analysis. IEEE Intelligent Systems 31, 2 (2016), 102–107.
12. Chella, A., Frixione, M., and Gaglio, S. A cognitive architecture for robot self-consciousness. Artificial intelligence in medicine 44, 2 (2008), 147–154.
13. Chella, A., and Manzotti, R. Artificial intelligence and consciousness. In Association for the advancement of Artificial Intelligence Fall Symposium (2007), pp. 1–8.
14. Chella, A., and Manzotti, R. Artificial consciousness. In Perception-Action Cycle. Springer, 2011, pp. 637–671.
15. Chib, S., and Greenberg, E. Understanding the metropolis-hastings algorithm. The american statistician 49, 4 (1995), 327–335.
16. Crick, F., and Clark, J. The astonishing hypothesis. Journal of Consciousness Studies 1, 1 (1994), 10–16.
17. Damasio, A., and Dolan, R. J. The feeling of what happens. Nature 401, 6756 (1999), 847–847.
18. Dehaene, S., and Changeux, J.-P. Ongoing spontaneous activity controls access to consciousness: a neuronal model for inattentional blindness. PLoS biology 3, 5 (2005).
19. Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Fei-Fei, L. Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition (2009), Ieee, pp. 248–255.
20. Deng, L., and Liu, Y. Deep learning in natural language processing. Springer, 2018.
21. Elgammal, A., Liu, B., Elhoseiny, M., and Mazzone, M. Can: Creative adversarial networks, generating” art” by learning about styles and deviating from style norms. arXiv preprint arXiv:1706.07068 (2017).
22. Fellbaum, C. Wordnet. The encyclopedia of applied linguistics (2012).
23. Gamez, D. The development and analysis of conscious machines. PhD thesis, University of Essex Colchester, 2008.
24. Gamez, D. Progress in machine consciousness. Consciousness and cognition 17, 3 (2008), 887–910.
25. Gamez, D. Human and machine consciousness. Open Book Publishers, 2018.
26. Suggesting cooking recipes through simulation and bayesian optimization. In International Conference on Intelligent Data Engineering and Automated Learning (2018), Springer, pp. 277–284.
27. Predictive entropy search for multi-objective bayesian optimization with constraints. Neurocomputing 361 (2019), 50–68.
28. Garrido-Merchn, E. C., Puente, C., and Palacios, R. Fake news detection by means of uncertainty weighted causal graphs, 2020.
29. Garrido-Merchn, E. C., Puente, C., Sobrino, A., and Olivas, J. A. Uncertainty weighted causal graphs, 2020.
30. Goertzel, B., and Pennachin, C. Artificial general intelligence, vol. 2. Springer, 2007.
31. Batch bayesian optimization via local penalization. In Artificial intelligence and statistics (2016), pp. 648–657.
32. Graziano, M. S. The attention schema theory: A foundation for engineering artificial consciousness. Frontiers in Robotics and AI 4 (2017), 60.
33. Harnad, S. Can a machine be conscious? how? Journal of Consciousness Studies 10, 4-5 (2003), 69–75.
34. He, B. J., and Raichle, M. E. The fmri signal, slow cortical potential and consciousness. Trends in cognitive sciences 13, 7 (2009), 302–309.
35. Kaiser, L., Gomez, A. N., Shazeer, N., Vaswani, A., Parmar, N., Jones, L., and Uszkoreit, J. One model to learn them all. arXiv preprint arXiv:1706.05137 (2017).
36. Kamitani, Y., and Tong, F. Decoding the visual and subjective contents of the human brain. Nature neuroscience 8, 5 (2005), 679–685.
37. Kitamura, T., Tahara, T., and Asami, K.-I. How can a robot have consciousness? Advanced Robotics 14, 4 (2000), 263–275.
38. Koch, C., and Tsuchiya, N. Attention and consciousness: two distinct brain processes. Trends in cognitive sciences 11, 1 (2007), 16–22.
39. Krizhevsky, A., Sutskever, I., and Hinton, G. E. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems (2012), pp. 1097–1105.
40. LeCun, Y., Bengio, Y., and Hinton, G. Deep learning. nature 521, 7553 (2015), 436–444.
41. Loar, B. Phenomenal states. Philosophical perspectives 4 (1990), 81–108.
42. Simulating music from the latent space of a variational autoencoder. B.S. thesis, UAM, 2019.
43. Moor, J. H. Testing robots for qualia. In Perspectives on mind. Springer, 1988, pp. 107–118.
44. Mordvintsev, A., Olah, C., and Tyka, M. Inceptionism: Going deeper into neural networks. Google Research Blog (2015).
45. Murphy, K. P. Machine learning: a probabilistic perspective. MIT press, 2012.
46. Pennartz, C., Farisco, M., and Evers, K. Indicators and criteria of consciousness in animals and intelligent machines: an inside-out approach. Frontiers in systems neuroscience 13 (2019), 25.
47. Perlis, D. Consciousness as self-function. Journal of Consciousness Studies 4, 5-6 (1997), 509–525.
48. Radford, A., Metz, L., and Chintala, S. Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:1511.06434 (2015).
49. Raoult, A., and Yampolskiy, R. Reviewing tests for machine consciousness. Retrieved from ResearchGate (2015).
50. Reggia, J. A. The rise of machine consciousness: Studying consciousness with computational models. Neural Networks 44 (2013), 112–131.
51. Roberts, G. O., Gelman, A., Gilks, W. R., et al. Weak convergence and optimal scaling of random walk metropolis algorithms. The annals of applied probability 7, 1 (1997), 110–120.
52. Rose, D. Consciousness: philosophical, psychological, and neural theories. Oxford University Press (2006).
53. Searle, J. R. Mind: A brief introduction. oxford university press, 2004.
54. Searle, J. R., Willis, S., et al. Consciousness and language. Cambridge University Press, 2002.
55. Shanahan, M. Consciousness, emotion, and imagination: a brain-inspired architecture for cognitive robotics. In In Proceedings of the AISB05 Workshop: Next Generation Approaches to Machine Consciousness (2005), Citeseer.
56. Snell, J., Swersky, K., and Zemel, R. Prototypical networks for few-shot learning. In Advances in neural information processing systems (2017), pp. 4077– 4087.
57. Solak, E., Murray-Smith, R., Leithead, W. E., Leith, D. J., and Rasmussen, C. E. Derivative observations in gaussian process models of dynamic systems. In Advances in neural information processing systems (2003), pp. 1057– 1064.
58. Sowa, J. F. Semantic networks. Citeseer (1987).
59. Stuart, S. A. Machine consciousness: Cognitive and kinaesthetic imagination. Journal of Consciousness Studies 14, 7 (2007), 141–153.
60. Thrun, S., and Pratt, L. Learning to learn. Springer Science & Business Media, 2012.
Meta-heuristics: Advances and trends in local search paradigms for optimization. Springer Science & Business Media, 2012.
62. Williams, C. K., and Rasmussen, C. E. Gaussian processes for machine learning, vol. 2. MIT press Cambridge, MA, 2006.
63. Wu, Z., Shen, C., and Van Den Hengel, A. Wider or deeper: Revisiting the resnet model for visual recognition. Pattern Recognition 90 (2019), 119–133.
64. Xie, Q., Hovy, E., Luong, M.-T., and Le, Q. V. Self-training with noisy student improves imagenet classification. arXiv preprint arXiv:1911.04252 (2019).
65. Xiong, W., Luo, W., Ma, L., Liu, W., and Luo, J. Learning to generate time-lapse videos using multi-stage dynamic generative adversarial networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2018), pp. 2364–2373.