Learn Generative AI | E2E Presentations and Material

GenAI create new trajectories of data by learning patterns from data. It makes it very creative as it can create new art, images and text. You can provide condition and it will create data according to conditions. This property of generative AI makes it power ful for personalization as it can create new images/text/responses according to individual attributes. Gen AI is also great in doing repetitive task such as crafting email, writing code and it makes it perfect for Automation.

  • Creativity
  • Personalization>
  • Automation
  • Generative AI Usage

    Here's the rewritten text:

    Generative AI has demonstrably achieved promising results in several areas, including:

    • Content creation and summarization: AI can generate different creative text formats, like articles, scripts, musical pieces, email, letters, etc. It can also summarize factual topics.
    • Question answering: AI can provide answers to your questions in an informative way, even if they are open ended, challenging, or strange.
    • Code writing assistance: AI can help developers write code by suggesting completions, fixing bugs, and generating entire programs.

    Generative AI is also making significant progress in:

    • Product ideation and creation: AI can help brainstorm new product ideas and even create prototypes, such as with Product KREATE.
    • Workflow reinvention: AI can automate tasks and suggest new workflows that can improve efficiency.

    Experienced teams are increasingly using generative AI for:

    • Dataset creation and augmentation: AI can generate new data or modify existing data to improve the quality and size of datasets used for training other AI models.

    However, as generative AI progresses, it's crucial to consider how AI threats are evolving as well. This includes:

    • The emergence of entirely new threats due to AI capabilities.
    • Changes to existing threats as AI becomes more sophisticated.
    • The potential expansion of existing threats as AI becomes more widely used.

    Tech Stack and modeling architectures

    Generative AI is based on "comprehend existing" data and determine trajectories data can take. It uses it for geenration

  • Diffusion architecture is suitable for generation
  • Transformer are suitable for language gentration in sequence
  • How to Evaluate Gen AI

    Traditional machine learning model has evaluaition metrics like accuracy. Generative AI creates new data. It evaluation is based on subjecive measures like diversity of data, realism, nobalty, creativity. It is hard to evaluate or benchmark geenrative models.

    Generative AI adoption framework

    Use above dimensions to identify quardant of your use case(s). Low risk and applicability of generic data e.g content writing for sales,travel guide are easy to adopt.

  • Areas where universal data is available but risk of geenrating wrong results are high - it is opportunity for companies that want to train and sell custom models
  • Areas where task specifci fine tuning is needed, is opprtunity for services companies
  • Companies that want to build defendable IP will focus on create new dataset and model training on these dataset for areas where risk is high and universal dataset are not available.
  • Trade off and Conflicts

    Generative AI has potential, but there are many challenges and open questions. One should consider these before using geenrative AI in enterprise(s)

    Uncontrolled data production

    Generative AI is based on "comprehend existing" data and determine trajectories data can take. It uses it for creating new data. However the method of producing new variation of data makes it controllable.

  • Generative Model output is unpredicatble and uncontrollable. Main issue is - how to get confidence if you want to use it in mission critical envioronment.
  • Large language Model (LLM) inherit bias from data they are trained on.
  • There are open questions on who have copy right on generated content. In future there may be new laws that will impact consumers of generative AI
  • LLM or Image model that are trained on universal data and produce new data are compute intensive. There are impact of enviornment one need to consider.
  • Enviornment concern and legal question

    There is significant amount of compute, energy usage. There is significant amount of carbon emission. One need to ensure it is for good cause and not for producing variation(s)

  • Dataknobs has created set of controls to handle this
  • GPT (Generative Pre-Trained Transformer) is family of large language model. developed by OPEN AI. GPT4 is latest generaral purpose LLM released by OpenAI. ChatGPT4 is chatbot focused LLM.

  • ChatGPT4 has large token length compared to GPT3.5 ChatGPT4 can process 25000 words of context. It is 8 times higher than chatGPT3.5
  • ChatGPT4 can understand and process visual input.
  • ChatGPT 4 has better programming capabilities compared to ChatGPT 3.5
  • ChatGPT 4 has fewer hallunication compared to ChatGPT 3.5
  • Digital Human

    Here is framework for Digital Agent, Virtual Assistant, Digital Inluencer and Digital Human.

    Virtual Agent to Digital Human

  • Virtual Agent/Digital Agent are for one off task.
  • Virtual assistant carry context and are ongoing engagement
  • Digital influencer add experience and emotion into interaction
  • Digtial Human provide experience/emotion for ongoing engagement.
  • Foundation Model

  • Foundation model work out of box for universal scenarios.
  • Specific models can be trained on these.
  • Reduce the labeling requirements
  • As FMs are exposed to internet scale data and various forms and myriad of patterns, FMs learn to apply their knowledge within a wide range of contexts.
  • Consideration to Extend Foundation Model

  • Extend and Fine tune for specific task
  • Train custom model for specific domain
  • Build datasets on which you can train model
  • Prompt Engineering

  • Give persona to model
  • Provide sub steps to complete task
  • Specify output format
  • Generative AI Vendors

  • Vendors: OpenAI, Microsoft, GCP, AWS, Anthropic, Dataknobs, Snorkel and more
  • Evaluation criteria : Features, accuracy, flexibility, ability to fine tune model, cost of inference, how reliable reults are
  • li>
  • Open AI and Micorosoft model is most used
  • li>
  • GCP bard provide up to date information. GCP also has TPU
  • AWS has large cloud share
  • Anthropic released caluse with 100K tokens
  • Hugging Face provide many smaller models
  • ChatGPT3.5 ChatGPT4 and Bard

  • Open AI has chatGPT3.5 and chatGPT4.0
  • Microsoft Azure provide OPEN AI services integrated with Azure
  • Google has Bard, Vertex AI with generative AI studio. In addition google has TPUs
  • AWS provide cloud to use existing capabilities

  • AWS bedrock enable using Hugging face, anthropic or other model on AWS cloud
  • Hugging Face is providing various small model like BERT, GPT-3, ROBERTA, XLNET
  • Anthropic has build Claude. Available to use at "poe . com". There are 3 flavors even with 100K tokens.
  • Generative AI Applications in Security

  • Generative AI is extremly useful for Cyber Security
  • Simulate phishing attack to check robustmess of security solution
  • Automate the analysis of security logs
  • Generative AI Applications in Payments Industry

  • Payments is highly regulated area
  • Customer Service can be made effective in Payment industry
  • Audit can be made more robust in payment industry
  • Check validation, Fraud detection can be improved