This is the multi-page printable view of this section. Click here to print.

Return to the regular view of this page.

Xebia AI Toolbox Documentation

We believe AI can help us if we use it in a responsible way. This means we are careful when working with AI tools regarding client data, privacy and security. We also believe in the power of open source and sharing knowledge. That is why we created this site to share our knowledge and help eachother in our daily work.

This website consits of a couple of parts: Workflows & Tools. The workflows are the actual workflows you can use to get things done. The tools are the tools you can use to get things done. The tools are often used in the workflows.

Next to using tools and workflows we also want to share our knowledge on how to use AI in a responsible way. This is why we have a section on Responsible AI where we explain how to use AI in such a way that it doesn’t hurt our company or our customers.

1 - AI Workflows

AI Workflow Collection

This website focuses on workflows to actually get things done instead of tools. This section describes a number of workflows to be more productive using AI. Have your own workflow of being more efficient & productive? please add it to this website!

Responsible AI Checklist

As we think responsible AI is essential, we should always consider this when using AI tools. Add this checklist to every workflow/tool page you create so people have a quick overview of what to consider when using this workflow or tool.

Responsible AI Checklist
Can be used with customer dataℹ️ Ask Consent / ✅ Yes, this tool is safe to use / ❌ No, this tool is not safe to use
Can the output be used at customer✅ Yes / ❌ No
Can be used with Xebia Internal secret data✅ Yes, this tool is safe to use / ❌ No, this tool is not safe to use
Can the output be used commercially by Xebia✅ Yes / ❌ No
Is data being stored in the region you use it✅ Yes / ❌ No
Do we have a Xebia license / managed solution for this tool✅ Yes / ❌ No
Tools used in workflowLinks to tool pages for these tools

1.1 - Creating an Annotated speaker deck for training purposestions from scratch

How can you create a PowerPoint deck with speaker notes so your presentation or training can be redelivered?
Responsible AI Checklist
Can be used with customer data input❌ No
Can the output be used at customer❓ TODO check this
Can be used with Xebia Internal secret data✅ yes
Can the output be used commercially by Xebia✅ yes
Is data being stored in the region you use it❌ No
Do we have a Xebia license / managed solution for this toolSlackGPT
Tools used in workflowSlackGPT, Whisper AI

Introduction

When you create a PowerPoint deck that can be used in a training or other sort of multi-delivery, it is hard to capture the story you want to convey in slides only. What do ou tell at every slide, what are the talking points and what story line do you want to follow. When you deliver the presentation yourself, this is doable, but what if someone else needs to use your deck? Or you deliver a training deck to a customer. For example, a customer wants a deck they can use for training their people. Then you want to annotate the slides with speaker notes, the story you want to tell so that people can read it, and the talking points so people can create their own story without losing the storyline.

No better way to capture this by recording the presentation right? Right! Bu that does not really scale well when preparing or delivering. So you want your story in the speaker notes.. But that is a lot of work! Yes indeed. And that is where this workflow comes in

Step 1: Deliver your presentation to your recording device

Deliver the presentation. On Windows, use the audio recorder and deliver your story as you would do it in a training or presentation. Start every new slide with <Slide 1>, <Slide 2>

Step 2: Create a transcript with Whisper AI

The audio file, wav, m4a etc has all the content. Install WhisperAI and run the tool by using the commandline

whisper youraudio.m4a --model medium 

You can mention teh language, although whisper can detect this as well. It can take some time to do this. As a workaround, create a VM in the cloud and let it run there.

Step 3: Style it

With the transcript that is generated by WhisperAI you can go to SlackGPT and use the following prompt per slide (manual copy paste)

I'll provide you with a transcript. You will start with a header "Talking Points" and then need to summarize the transcript into bullet points and a short descriptive text of the point underneath. The description of talking points need to be in blog style. Described as an outside observer. Write clear and use imperative tone. Only use information that is provided in the transcript.
Then, add a header "speaker text" and write a text that someone can read to present this to an audience. Do not use announcer speech or things as today. Treat this as it is in the middle of a presentation
Here is the transcript:

Examples

I'll provide you with a transcript. You will start with a header "Talking Points" and then need to summarize the transcript into bullet points and a short descriptive text of the point underneath. The description of talking points need to be in blog style. Described as an outside observer. Write clear and use imperative tone. Only use information that is provided in the transcript.
Then, add a header "speaker text" and write a text that someone can read to present this to an audience. Do not use announcer speech or things as today. Treat this as it is in the middle of a presentation
Here is the transcript:

So let's get started with an introduction to
GitHub Advanced Security for Azure DevOps or  GHAZDO.
So in this module, we will talk a little bit about the context of why we
need things like advanced security and why this
is becoming much more important than it maybe was in the past.

Output

Talking Points
- Introduction to GitHub Advanced Security for Azure DevOps (GHAZDO)
  * In this part of the presentation, the speaker introduces the audience to GitHub Advanced Security for Azure DevOps, also known as GHAZDO. This topic is crucial to understand due to the increasing importance of advanced security in today's world.
- The context of advanced security
  * The speaker will discuss the reasons behind the growing need for advanced security measures, and why it is more important now than ever before.
Speaker Text
Now, let's dive into the topic of GitHub Advanced Security for Azure DevOps, or GHAZDO. In this module, we'll explore the context behind the increasing demand for advanced security and why it has become a critical aspect of our digital lives.
As technology continues to evolve, so do the potential threats and vulnerabilities we face. This makes it essential for us to understand and implement advanced security measures to protect our systems and data. So, let's discuss the importance of advanced security and how GHAZDO can help us ensure a safer digital environment.

1.2 - Creating Photorealistic Images

How can you combine ChatGPT and Midjourney to create photorealistic images?
Responsible AI Checklist
Can be used with customer data input❌ No
Can output be used at customer✅ Yes
Can be used with Xebia Internal secret data❌ No
Can output be used commercially by Xebia✅ Yes
Is data being stored in the region you use it❌ No
Do we have a Xebia license / managed solution for this workflow❌ No
Tools used in workflowMidjourney, ChatGPT / SlackGPT

Introduction

Do you want to create photorealistic images with Midjourney, but get stuck when you need to specify your prompt? You can teach ChatGPT/SlackGPT to generate prompts for you. The generated prompt includes style, camera type, and even camera settings. This document describes the process, but the initial script can be changed to create other styles of images.

Important: Credit

The steps described on this page were designed by the YouTube channel AI Foundations. The author created a video on this subject that greatly improves the Midjourney experience.

Steps

Step 1: Add the introduction script to ChatGPT

Download the script on the original author’s website. You can paste this script into ChatGPT, or even SlackGPT. After you’ve sent the script, the AI assistant will respond with a resounding “YES”.

Step 2: Tell the assistant about your subject

What kind of picture do you need? I wanted to generate a ‘A photo of a rubber duck sitting on a monitor’. SlackGPT responded with:

Realistic photograph of a cheerful yellow rubber duck, playfully perched on top of a computer monitor in a cozy office setting, soft ambient lighting, blurred background showcasing office desk and accessories, Nikon D850, 50mm lens, f/1.8, natural light –ar 3:2 –v 5 –q 1

Step 3: Give the prompt to Midjourney

To get started with Midjourney, start here. Currently, Midjourney is only accessible through Discord. Copy the prompt, and prefix it with /imagine. Paste this into Midjourney on Discord and it will generate options for you. Here’s the result: duckies

Note: All Midjourney prompts and results are publicly visible, unless you have a premium subscription with Stealth Mode enabled.

Licenses needed

SlackGPT

You can use SlackGPT on the Xebia Slack. It’s a great alternative for ChatGPT.

Midjourney

You need a personal license. Find out more about Midjourney here.

1.3 - Creating Presentations from scratch

How can SlackGPT help you with creating your presentations?
Responsible AI Checklist
Can be used with customer data input❌ No
Can the output be used at customer❓ TODO check this
Can be used with Xebia Internal secret data✅ yes
Can the output be used commercially by Xebia✅ yes
Is data being stored in the region you use it❌ No
Do we have a Xebia license / managed solution for this toolSlackGPT
Tools used in workflowSlackGPT

Introduction

Creating a presentation can be hard. Especially the initial part. This workflow gets you going from nothing to a full presentation in powerpoint in a couple of minutes from which you can start adding styles and extra content.

Step 1: Open the Visual Basic Editor

Windows:

Go to Developer1 > Visual Basic

Mac:

Go to Tools > Macro > Visual Basic Editor

Next insert a Module: Insert > Module

Step 2: Ask SlackGPT to do your homework

Next up we are going to ask SlackGPT to generate a Visual Basic script that will generate a presentation for us. This is mostly Prompt engineering.

Wether you know or you don’t know your presentation out-line your prompt should probably start with something like this:

    Generate VBA script in PowerPoint that on execution generates slides.
    The Topic of the slide deck is: [The benefits of having ChatGPT do you work]
    The length of the slide deck is: [Minimum of 10 slides]
    
    Think like a C# developer that is trying to save his job by giving this presentation
    make sure to generate sub points on all the slides

Run the script.

Step 3: Style it

All that is left is to style your slides, if you don’t have a house-style design you can use the Integrated feature of PowerPoint “Designer” that should be located on the Home Ribbon.


  1. If you don’t see the Developer “Ribbon” follow these steps:

    • Go to File > Options
    • Customize Ribbon
    • Main Tabs > Developer
    • Ok
     ↩︎

2 - Responsible AI

Thoughts and Considerations when using AI for your work

Avoiding data leaks

When using AI tools you often have to upload data to the cloud. This can be data from your clients or data from your company. You should always be careful when uploading client or company data to the cloud. You should always check if the data you are uploading is allowed and what will happen to this data.

⚠️ Most free (and certain also paid) AI tools have policies that all data sent to it can be either stored and used for training their model or be used for other purposes. This means that if you upload client data to these tools you are violating the privacy of your client. This can have legal consequences for you and your company.

In our Tools section we describe which tools are safe to use, which aren’t and what are the things you should consider when using them. It might not always be obvious which data a tool is using, for example IDE plugins that help you code often send parts of your solution to the cloud to help you code. This might be a problem when you are working on a client project that wants to keep their code secret.

First rule for using any AI tool when working for your customer is to have consent from your customer in using these tools. Again the Tools section has a description on which tools are safe and how to convince your customer to use them by providing proof to them of how the data is used/processed and what the risks are.

You’re The Pilot

Whether you’re using GitHub Copilot, or other AI tools, always remember, you’re responsible for the end result. Review and reflect on the output of any AI tool.

  • Are there bugs in the generated code?
  • Is the generated material a blatant copy of a unique source?
  • Does the generated code create a security risk?

Ethical use of AI

Artificial Intelligence can be an incredibly strong tool. However, with great power, comes great responsibility. Whether you’re building your own artificial intelligence, or using an AI tool, always be sure that it:

  • Is reliable and safe.
  • Does not discriminate against individuals or groups.
  • Does not use copyrighted material to generate results.

3 - AI Tools

AI Tools Collection

This website focusses on workflows to actually get things done instead of tools. When using AI tools they often require licenses and some might not be suitable to work with client data. Are you using a specific tool create a page on a couple of things:

  • What is the tool?
  • how to use it?
  • What is the license?
  • Is it suitable to be used at clients
  • Is there a Xebia managed solution / alternative you could use?
  • If the tool can be used at clients how to convince your client to use it. what is the proof that this tool is safe to use, will not steal data, etc. Colleagues can use this proof to have conversations with clients.

Responsible AI Checklist

Add this checklist to every workflow / tool page you are creating so people have a quick overview of what to consider when using this workflow or tool.

Responsible AI Checklist
Can be used with customer dataℹ️ Ask Consent / ✅ Yes this tool is safe to use / ❌ No this tool is not safe to use
Can the output be used at customer✅ Yes / ❌ No
Can be used with Xebia Internal secret data✅ Yes this tool is safe to use / ❌ No this tool is not safe to use
Can the output be used commercially by Xebia✅ Yes / ❌ No
Is data being stored in the region you use it✅ Yes / ❌ No
Do we have a Xebia license / managed solution for this tool✅ Yes / ❌ No
Tools used in workflowLinks to tool pages for these tools

3.1 - ChatGPT

ChatGPT is a chatbot powered by OpenAI’s GPT models.
Responsible AI Checklist
Can be used with customer data❌ No
Can the output be used at customer✅ Yes
Can be used with Xebia Internal secret data❌ No
Can the output be used commercially by Xebia❓TODO VERIFY PROOF
Is data being stored in the region you use it❌ No
Do we have a Xebia license / managed solution for this tool✅ Yes, please use SlackGPT

What is ChatGPT

ChatGPT (Chat Generative Pre-Trained Transformer) is an artificial intelligence chatbot developed by OpenAI.

How to use ChatGPT

You can visit the website to have a conversation with ChatGPT.

License / Costs

While ChatGPT is free, you can opt for a ChatGPT Plus license. It enables the following:

  • General access to ChatGPT, even during peak times
  • Faster response times
  • Priority access to new features and improvements

Suitable to use with clients?

In general, no. ChatGPT stores all your conversations, including all the data you sent to ChatGPT. You can turn off this feature but still you’re sending sensitive data to OpenAI.

If you need a safer chat-like experience backed by a GPT model, try Xebia’s SlackGPT. This application uses a paid endpoint, which ensures your data is not used to train the GPT models.

3.2 - Midjourney

Midjourney is a generative AI that produces images.
Responsible AI Checklist
Can be used with customer dataℹ️ Ask Consent
Can the output be used at customer✅ Yes
Can be used with Xebia Internal secret data❌ Any input you give Midjourney is publicly visible by default
Can the output be used commercially by Xebia✅ Yes
Is data being stored in the region you use it❌ No
Do we have a Xebia license / managed solution for this tool❌ Yes

What is Midjourney

From the website:

Midjourney is an independent research lab exploring new mediums of thought and expanding the imaginative powers of the human species.

However, when we refer to Midjourney on this website, we mean the Midjourney Discord Bot. Currently, the Midjourney generative AI is only available through Discord. Interacting with the software is done by adding this bot to your Discord channel or chatting with the bot directly.

How to use Midjourney

The Quick Start is available here.

The Pro and Mega plan offer Stealth Mode. This mode prevents your generated content from publicly appearing on Midjourney’s website. This mode is not enabled by default.

License / Costs

Midjourney has several subscription plans. From the docs:

You must purchase the Pro or Mega plan if you are a company making more than $1,000,000 USD in gross revenue per year.

Suitable to use with clients?

3.3 - SlackGPT

ChatGPT alternative with responsible use of data in Xebia Slack
Responsible AI Checklist
Can be used with customer dataℹ️ Ask Consent
Can the output be used at customer✅ Yes
Can be used with Xebia Internal secret data✅ Yes this tool is safe to use
Can the output be used commercially by Xebia❓TODO VERIFY PROOF
Is data being stored in the region you use itCurrently in Azure West Europe (Netherlands)
Do we have a Xebia license / managed solution for this tool✅ Yes

What is SlackGPT

SlackGPT was created at Xebia to offer an observable alternative to ChatGPT. The data that you send to SlackGPT is not stored anywhere, but does use the OpenAI GPT models. You can read more about the software here.

Because it uses a paid endpoint, our data will not be used to train ChatGPT or the GPT models.

How to use SlackGPT

SlackGPT is an app on the Xebia slack. You can chat with it directly. Every message will start a thread, which is the equivalent of ChatGPT’s ‘chat’.

License / Costs

The costs are covered by Xebia. Please use SlackGPT to your heart’s content!

Suitable to use with clients?

It depends, if your client consents to their data being sent to the OpenAI endpoints, this is allowed. If you trigger the Microsoft content filters, the data might be viewed by humans at Microsoft.

The guidance that SlackGPT will give you when starting a new thread:

  • The messages you send to SlackGPT are not stored or read by anyone within Xebia
  • We log usage metrics to track cost and get insights of how many people are using SlackGPT
  • Microsoft might review the messages if they suspect abuse of their API

As a rule of thumb: don’t put anything in here that you wouldn’t put in Google Translate.

3.4 - Whisper AI

Whisper is a general-purpose speech recognition model. It is trained on a large dataset of diverse audio and is also a multitasking model that can perform multilingual speech recognition, speech translation, and language identification. You can generate transcripts from audio files.
Responsible AI Checklist
Can be used with customer data❌ No
Can the output be used at customer✅ Yes
Can be used with Xebia Internal secret data❌ No
Can the output be used commercially by Xebia❓TODO VERIFY PROOF
Is data being stored in the region you use it❌ No
Do we have a Xebia license / managed solution for this tool❌ No

What is Whisper AI

Whisper is a general-purpose speech recognition model. It is trained on a large dataset of diverse audio and is also a multitasking model that can perform multilingual speech recognition, speech translation, and language identification. You can generate transcripts from audio files.

How to use Whisper AI

You can visit the website to follow instructions. In short. You download the tools and run whisper on your commandline. You can use multiple language models. The bigger the model, the more accurate the transcript. Although in many cases, small or medium is sufficient.

License / Costs

whisper is free

Suitable to use with clients?

It generates a transcript from an audio file. It does so locally. But please check customer. Also make sure the transcript does not end up somewhere.