Personal tools

Generative AI

Harvard (Charles River) IMG 7718
(Harvard University - Harvard Taiwan Student Association)


- Generative AI Models

Generative AI enables users to quickly generate new content based on a variety of inputs. The input and output of these models can include text, images, sounds, animations, 3D models, or other types of data. 

Generative AI models use neural networks to identify patterns and structures in existing data to generate new, original content. 

One of the breakthroughs in generative AI models is the ability to train using different learning methods, including unsupervised or semi-supervised learning. This enables organizations to more easily and quickly leverage large amounts of unlabeled data to create underlying models. As the name suggests, base models can be used as the basis for AI systems that can perform multiple tasks. 

Examples of foundational models include GPT-3 and Stable Diffusion, which allow users to harness the power of language. 

For example, popular applications such as ChatGPT, derived from GPT-3, allow users to generate articles based on short text requests. 

Stable diffusion, on the other hand, allows users to generate realistic images given text input.


- Generative AI Tools

Generative AI tools are software or systems that use neural network techniques to process input data and produce responses. These tools are trained using natural language processing, deep learning AI algorithms, and neural networks. They use advanced machine learning techniques, such as generative adversarial networks (GANs) or variational autoencoders (VAEs). 

Generative AI tools can work with various modalities, such as: Text, Imagery, Music, Code, Voices.
Here are some examples of generative AI tools:

  • Text generation tools: GPT, Jasper, AI-Writer, and Lex
  • Image generation tools: Dall-E 2, Midjourney, and Stable Diffusion
  • Code suggestions: CodeWhisperer can generate code suggestions in real-time, including snippets and full functions
  • Claude: Can take direction on tone, behavior, and personality
  • Anthropic: Offers Claude for Business, which is an AI assistant for work-based tasks


Unlike traditional AI, generative AI can learn from data and generate content autonomously


- Real-world Applications for Generative AI

Generative AI has many real-world applications, including:
  • Creating images: Generative AI can create realistic images, such as photographs of people or objects that do not actually exist. This can be used for tasks such as creating virtual product mockups or generating training data for image recognition models.
  • Healthcare: Generative AI has many applications in healthcare, including drug discovery, disease diagnosis, and patient care.
  • Audio synthesis: Generative AI can transform any computer-generated voice into one that sounds authentically human.
  • Marketing: Generative AI can be used in marketing to develop chatbots and virtual assistants. With the ability to respond to customer queries in real time, these AI-powered chatbots can help organizations enhance customer engagement and provide better customer support.
  • Music creation: Generative AI models can easily produce new music pieces and generate complete audio by learning the styles and patterns of the music a user inputs.
  • Logistics and transportation: AI can optimize routes and delivery schedules, track shipments in real-time, and predict potential delays or disruptions in the supply chain.

Other applications for generative AI include: surveillance, advertising, education, gaming, media, podcasting.


[Hallstatt, Austria - Civil Engineering Discoveries]

- Steps To Build Your Own Generative AI

Building generative AI solutions requires a deep understanding of the technology and the specific problems it aims to solve. It involves designing and training artificial intelligence models to generate novel outputs based on input data, often optimizing specific metrics. 

To build a successful generative AI solution, several key steps must be performed, including defining the problem, collecting and preprocessing data, selecting appropriate algorithms and models, training and fine-tuning the model, and deploying the solution in a real-world environment. 

Here are some steps you can take to build your own generative AI:

  • Understand the problem: Identify the problem and potential use cases.
  • Gather data: Collect a large, diverse dataset of images relevant to the desired output.
  • Preprocess data: Prioritize cleaning to fix or remove corrupted, incorrectly formatted, duplicate, or incomplete data. Also, normalize data to eliminate redundant and unstructured data.
  • Select a model architecture: Choose a foundational model.
  • Train the model: Train the model optionally.
  • Evaluate and fine-tune: Evaluate and refine the model.
  • Test the model: Deploy the model.
  • Monitor and maintain the model: Integrate it into the application.


[More to come ...]

Document Actions