Artificial intelligence

Neural networks and learning
  1. Machine learning as function approximation; statistical and cognitive motivations 
  2. Two ways to understand overfitting (plus notes on hyperparameter optimization)
  3. Backpropagation and the chain rule
  4. Overview of basic neural network architectures
+ universal approximation, Turing completeness of recurrent neural networks
    Encoding and feature abstraction
    1. Natural Language Processing
    2. Knowledge abstraction and representation 
    Refinements 
    1. Ways to imply a better prior (lasso, ridge, batch normalization, dropout)
    2. Other optimization algorithms (Nesterov, Adam etc.)
    3. "Technical problems" (VGP, catastrophic forgeting, etc.)
    4. Bayesian networks
    Projects
    1. A deeper look into convolutional networks
    2. Neural networks to simulate an entropy source
    3. This Chinese character does not exist (Trained version on Github)
    4. This Letter does not exist
    5. One-shot generative neural networks
    6. Random walk of character shapes
    7. This font does not exist
    8. Predict Stackoverflow answer time
    9. Nonlinear eigenfaces
    10. Peeking into GANNs
    11. Various GANN projects: deepfakes, adverserial images, differentiable physics
    12. AI colorize, high-res, framerate, etc. 
    13. NLP WTW/TOMT (e.g. "disrecommend" --> "dissuade", "arbitraryhood" --> "arbitrariness")
    14. Neural style transfer on tunes
    Resources
    Kaggle etc.
    Some better visualization of CNN features
    Progressive GANs
    https://openai.com/blog/generative-models/
    https://blog.otoro.net/2015/12/28/recurrent-net-dreams-up-fake-chinese-characters-in-vector-format-with-tensorflow/
    https://www.researchgate.net/publication/329007858_W-Net_One-Shot_Arbitrary-Style_Chinese_Character_Generation_with_Deep_Neural_Networks_25th_International_Conference_ICONIP_2018_Siem_Reap_Cambodia_December_13-16_2018_Proceedings_Part_V
    https://towardsdatascience.com/progressive-neural-networks-explained-implemented-6f07366d714d
    https://sorenbouma.github.io/blog/oneshot/

    https://towardsdatascience.com/@joseph.rocca
    https://nptel.ac.in/courses/128/106/128106011/
    http://colah.github.io/posts/2014-03-NN-Manifolds-Topology/
    https://distill.pub/2017/momentum/

    No comments:

    Post a Comment