LiveKit is an open-source project that provides scalable, multi-user conferencing over WebRTC. It’s designed to provide everything you need to build real-time audio and video experiences in your applications.

A video conferencing application may not be accessible to all audiences and can be arduous to build. Modern applications need built-in intelligence to be more inclusive of all audiences.

Symbl.ai provides out-of-the-box conversation intelligence capabilities to deeply analyze the spoken conversations that occur over video applications. One of these capabilities is live transcription, or speech-to-text. This feature allows you to convert the conversations from a verbal form to a textual form and display it to users.

Combining these two platforms, we have built a multi-party video-conferencing application that demonstrates Symbl.ai’s real-time APIs in the form of Closed Captions.

This application was inspired by LiveKit’s video app and is built using LiveKit’s React SDK and Create React App.

Features

Before we get into the details on how to build Symbl.ai’s LiveKit RTC App, let’s talk about its available features. This video app integrated with Symbl.ai’s real-time APIs provides the following out-of-the-box conversation intelligence features:

• Live closed captioning: Live closed captioning is enabled by default and provides a real-time transcription of your audio content.
• Real-time transcription: Symbl.ai offers state-of-the-art speech-to-text capability (also called transcription). You can get audio and video conversations transcriptions in real-time.
  Real-time insights: Symbl.ai allows you to get the real-time insights (action items, questions and follow ups) of the conversations.
• Real-time topics with sentiments: Symbl.ai allows you to get the real-time topics of the conversations along with their sentiments.
• Real-time trackers detection: Symbl.ai allows real-time detection of the trackers in the conversation.
• Real-time sentiment analysis of the conversations: Symbl.ai allows you to get real-time sentiment analysis (sentence level) and aggregated/overall sentiment categorisation of the conversations.
• Real-time meeting metrics: Symbl.ai allows you to get real-time analytics of total talktime, total silence and total overlapping time of the meeting.
• Real-time member metrics: Demonstrates the talktime or contribution of a member in the conversations.
• Video conferencing with real-time video and audio: This allows you to use this for real-time use cases where both the video, audio, and its results from Symbl.ai’s back-end need to be available in real-time. It can be integrated directly via the browser or server.
• Enable/disable camera: After connecting your camera you can enable or disable the camera when you want.
• Mute/unmute mic: After you connect to your device’s microphone you can mute or unmute when you want.
• Screen sharing: This can be used to capture the screen directly from the web app.

Without further ado, let’s get started! 

Prerequisites

Some essential items for the checklist:

• Node JS (version 14+)
• Symbl.ai Account

Setting up Symbl.ai 

Create a free Symbl.ai account here and generate an access token.

Structure of Components

Installation

Setup

1. Clone the project.

git clone https://github.com/SymblDev/symbl-livekit-rtc-app.git

2. Go to the project directory.

cd symbl-livekit-rtc-app

3. Install dependencies.

npm install

Run Locally

1. Navigate to the src/symbl/config/ directory and open the config.js file.
2. Add your Symbl.ai App Id and App Secret values in the respective fields below:
   

appId: ' ',
appSecret: ' '

3.  Modify the rest of the configuration such as Trackers, Sentiment Analytics as per requirements. [Optional]

realtimeSentimentAnalysis: true,
realtimeAnalyticsMetric: true,
trackers: [
  {
    name: "Promotion Mention",
    vocabulary: [
     "We have a special promotion going on if you book this before",
     "I can offer you a discount of 10 20 percent you being a new customer for us",
     "We have our month special this month",
     "We have a sale right now on"
    ]
  }
]

4. Start the application.

npm start

The application will be started at http://localhost:3000

Usage

1. Navigate to http://localhost:3000
2. Enter the LiveKit URL—utilize the LiveKit’s playground server URL: wss://demo.livekit.cloud.
3. Enter the Token generated using the LiveKit’s Server. If the LiveKit server is not running at the localhost, we can utilize the LiveKit’s playground server URL to generate token.

curl --location --request POST 'https://livekit.io/api/playground/tokens' \
--header 'authority: livekit.io' \
--header 'Content-Type: text/plain;charset=UTF-8' \
   	--data-raw '{
       "roomName": "tower",
       "userName": "Stark"
   	}'

4. Click on Connect to enter the Room.

5. Closed Captioning will appear on the screen as soon as a person starts speaking.

6. To view the Symbl’s Conversation Intelligence (Transcripts, Insights, Topics, Trackers), click on the down arrow that appears in the bottom right corner as soon as Symbl’s intelligence is generated.

Adding Multiple Participants in a Room

If you want to see how the application behaves with multiple participants, you can simply open localhost:3000 in multiple tabs in your browser and connect to the same room using different user names.

Additionally, if you would like to invite other participants to a room, each participant would need to have their own installation of this application and use the same room name and Account SID (the API Key and Secret can be different).

Screenshots

• Real-time Transcripts, Insights (Action Items, Questions and Follow Ups), Topics, Live Closed captioning
• Real-time Topics with sentiments
• Sentiment and Meeting Analytics, overall sentiment

Real Life Use Cases

There are many use cases and benefits of using a video conferencing app with conversation intelligence capabilities. You can extend your application and build wonderful projects based on the following things. 

Recruiting and HR Intelligence

• Empower hiring managers with empathy-driven insights that improve behaviors and emotional intelligence during interviews.
• Detect and measure candidates and interview empathy in real-time and post-interaction.
• Coach hiring managers by creating a playbook of the most insightful questions and interview tactics which creates a consistent and impartial interview process.
  

Remote Collaboration 

• Increase productivity for every meeting attendee with advanced conversation intelligence.
  • Aggregate meeting data. Get real-time transcription and topics for quicker and more seamless collaboration
  • Integrate and share anywhere, anytime. Create integrations with to-do’s directly with your favorite calendar, log follow-up items to your CRM, send meeting summaries to Slack or any other meeting application.

Revenue and Sales Intelligence

• Empower sales teams with AI-driven meeting notes, follow-ups, and action items.
  • Real-Time call performance – Understand key conversation drivers as they happen. Track script adherence, specific playbook utterances, and caller intent. Detect when specific risk factors are present like low talk-time, silence, negative sentiments, etc.
  • Sales Coaching – Analyze call behavior for your top performers and improve your entire team’s skills to increase deal performance. Uncover topic duration, question rate, and talk ratios to create personalized coaching recommendations for each sales rep in real-time and asynchronously.

Trend Analysis – Analyze thousands of sales calls and uncover hidden trends in your customer conversations.

Contributing

We welcome your contributions to make the Symbl LiveKit RTC App better! This guide is actively developed, and we love to hear from you.

Please feel free to create an issue or open a pull request with your questions, comments, suggestions, and feedback. If you liked our integration guide, please star our repo! 

Community

If you have any further questions, feel free to reach out to us through our Community Slack or submit PRs.

Connect with us 

• Slack: https://bit.ly/symbldotai-slack
• Twitter: @symbldotai 
• Github: https://github.com/symblai 

Feel free to reach out to me, Akanksha Bhasin, your Symbl.ai Community advocate, if you are interested in learning more about our community, becoming a Symbl.ai ambassador, or have general questions about Symbl.ai.

• Linkedin: https://www.linkedin.com/in/akankshabhasin

Next Steps

In this tutorial, you learned how to build a multi-party video-conferencing application using LiveKit and integrate conversation intelligence using Symbl.ai. If you have any questions, join Symbl.ai’s Community Slack or reach out to developers@symbl.ai. This entire code for this project is available in this GitHub repository. I want to hear if you found it helpful or have any feedback so say hi on Twitter or email! 

The post How to Build a Video Conferencing Application with LiveKit and Symbl.ai appeared first on Symbl.ai.

We are pumped to collaborate with Devscript on the Full Stack Squared Conference. DevScript is a global student-run non-profit product-based technical community of 10k+ members spread over 9+ countries, run by a group of developers for techolics, with a motto of ‘Where Development meets Opportunities!’

So let’s begin with the Symbl.ai Summarisation Challenge!! Follow the steps below to enter:

1. Sign up for a FREE developer account (receiving $150 credits) using this link.

2. View our Summarization and POST Video API Docs

3. Submit your favorite video with Symbl.ai’s Async API. This will return a "conversationId".

• For locally downloaded file, follow the steps in https://docs.symbl.ai/docs/async-api/overview/video/post-video. Make sure to update your endpoints like so: POST https://api.symbl.ai/v1/process/video?enableSummary=true
• If you have a URL, follow the steps in  https://docs.symbl.ai/docs/async-api/overview/video/post-video-url. Make sure to update your endpoints like so: POST https://api.symbl.ai/v1/process/video/url?enableSummary=true

Be sure to proceed with the following!

• Use either of the following base URLs: "https://api.symbl.ai" or "https://api-labs.symbl.ai".
• Make sure to add the query parameter of ?enableSummary=true.

4. When the video is finished processing, you can extract summarization with a simple REST endpoint call to ‘GET https://api.symbl.ai/v1/conversations/{conversationId}/summary’. Below is a code snippet in Javascript with the ‘request’ module.

const request = require('request'); 
const authToken = AUTH_TOKEN;;
     url: `https://api.symbl.ai/v1/conversations/{conversationId}/summary`,
     headers: { 'Authorization': `Bearer ${authToken}` },
     json: true }, (err, response, body) => {
     console.log(body); });

5. Tweet a screenshot to @symbldotai and @symbldev on Twitter OR post on LinkedIn tagging Symbl.ai of the summary text you generated with the hashtags #BuildWithSymbl #SymblChallenge #SymblatDevScript, along with a link (only if you used a video URL) to the video you processed

6. Fill out this submission form to provide contact info for prizes and feedback on our Summarization API.

7. Tweets/posts must be posted by February 16, 2022 to qualify.

Prizes:

• 10 lucky participants who complete the challenge will be randomly selected to win a $10 Gift Card
• Symbl.ai T-shirt and exclusive stickers to the lucky 15 folks who participate in the challenge before 17th February.

Additional Resources:

• How to get a Summary using Async API
• Symbl.ai’s POST Video URL API
• Check out our Symbl.ai 101 video
• Join our Slack Community

The post Symbl.ai Summarization API Challenge at DevScript appeared first on Symbl.ai.

Share:

Hey fellow devs!

We are thrilled to announce a new Python CI coding challenge on Qualified.io. Put your Python skills to the test and win some cool prizes and bragging rights by building conversation intelligence functions. In case you are not familiar with what Conversation Intelligence (CI) is, it’s essentially AI that can understand natural human conversations, explicitly and contextually (see this video for more info).

📜 The Challenge:

In this cool challenge, you will take on the identity of a “Python Agent’ and venture into the mystic land of Convotopia. Combining your Python skills and CI APIs (provided by Symbl.ai), you will build functions for extracting the undiscovered secrets (conversation insights) hidden deep within Convotopia. Prepare yourself to take on greater challenges as you venture deeper into Convotopia.

The challenge is divided into 5 Levels, with each passing level you gain super powers to unlock the next level and be a Python hero in Convotopia. ⛳

Start the challenge here: https://bit.ly/SymblCIQuest-Q1

⏳Time Commitment:

The challenge will take approximately 1 hour and 30 mins (or less) to complete all levels, depending on your level of expertise with Python and/or conversation intelligence APIs (provided by Symbl.ai).

Why should you commit 1.5 hours of your life? You can win some cool prizes completing the challenge (see section below for details).

Approx time for each level:

Level 1. Access to Convotopia Land – 20 mins

Level 2. Connect with the locals – 20 mins

Level 3. Are you connecting with the locals? – 20 mins

Level 4. Let the extraction begin –  30 mins

Level 5. What is the ‘Talk of the town’ in Convotopia? – 30 mins

👨🏻‍💻👩🏻‍💻Who Can Participate:

Our Challenge is open to programmers (or not) from all across the globe. If you are interested in building Python functions and exploring AI functions, this is the challenge for you.

🏆 Prizes: 

Complete the challenge and win some cool prizes:

• $50 Amazon gift card – The first 4 participants to complete the challenge with 100% by 15th February.
• $25 Amazon gift card – not among the first 4 to complete the challenge or didn’t score 100%? No worries, every week, between 15th February to 15th May we will randomly select a winner who completed 80% or more of the challenge to win.
• Symbl.ai Developer Swag  – first 50 participants who complete 80% of the challenge by March 30th.

All participants who successfully complete the challenge, will receive a certificate of completion (bragging rights to share on social).

🔥 How to participate?

1. Head over to the Challenge to register yourselves and get started – Link ✔️
2. Join our slack channel 🚩
3. Publish a social media post about your participation and experience, and tag @symbldotai and @symbldev .📢
4. Add the #BuildWithSymbl #SymblQuest hashtag to your posts and share it with the community. ✨
5. Fill in the Challenge completion swag form.🎁

🤗 Join our Symbl.ai Community!
Become a part of our Slack community and do follow us on Twitter, Linkedin, Youtube, Github, Facebook and Instagram! ❤️

📩 Contact us
If you have any questions, please don’t hesitate to drop us an email at: developer@symbl.ai 

Happy Hacking!

May the source be with you! ✊🏻

✍🏽 By Akanksha Bhasin, DevRel @ Symbl.ai

The post Test Out Your Python Skills on Building Conversation Intelligence Functions appeared first on Symbl.ai.

It feels like we just announced Symbl.ai’s Hacktoberfest a while back, but it has officially come to a close.

⭐ Some Amazing Stats from our 3 repos that were a part of hacktoberfest:

Symbl Agora – 32 contributions (12 issues + 20 PRs)
Symbl Twilio – 20 contributions (15 issues + 5 PRs)
Symbl Docs – 15 contributions (6 issues + 9 PRs)

On behalf of me and my Symbl.ai team, we thank each and every one of you for your contributions in open source. Your involvement and enthusiasm blew us away, with participants ranging from school kids, professionals, community members to people completely new to our ecosystem.

We would also like to appreciate our Good Contributors during the Hacktoberfest.

• Vanshaj Poonia
• Asian Cat
• atom19-i
• Aman Bedi
• Sproff

Huge shout out to our Project Maintainers and stakeholders from Symbl.ai Team: Vishal, Shivam, Akanksha, Rishabh, Marcelo, Vaibhav, Janhavi and Pema.

⏳ We’re currently in the process of reviewing all submissions, and everyone who completed our Hacktoberfest challenge will receive a limited edition T-shirt, and stickers depending on the contribution level.

✅ Participants who meet all the requirements will receive an email in the coming week with a swag form and shipping instructions. We appreciate your patience – they’re coming soon!

Anything you’d like to see at Symbl.ai’s Hacktoberfest next year? Let me know via email (akanksha.bhasin@symbl.ai).

Hacktoberfest is over, but you still can contribute to our repositories anytime. Read more about us on Symbl.ai Docs + Open Source repos.

Join our Symbl.ai community here

Slack Group: https://bit.ly/symbldotai-slack
Twitter: @SymblDev and @symbldotai
Akanksha Bhasin’s Twitter

Happy Hacking!

Cheers,
Akanksha

The post Symbl.ai’s Hacktoberfest 2021: Thank you for participating! appeared first on Symbl.ai.

We invite all developers, new or experienced, and open source enthusiasts to contribute to Symbl.ai throughout the month of October by opening new issues or working on existing issues by submitting a pull request (PR) against any Symbl.ai repositories with the Hacktoberfest label. Valid PRs raised and eventually merged will be eligible for Symbl.ai Developer Swag!!

Learn more here: https://hacktoberfest.digitalocean.com

How does it work?

We will be accepting development (feature requests/bug reports) and contributions on three of our repos below:

• Docs
• Agora RTE App
• Twilio Video React App

We love feedback! Sending feedback is a great way for us to understand your different use cases/issues raised. If you have any issues, bugs, or want to share about your experience, feel free to do so on our support channel of Community Slack.

Developer Swag

If you contribute to our docs, raise an issue, or create a PR, with approval from the Symbl.ai team, you will be eligible for exclusive Symbl.ai stickers.

Raise more than one issue or PR and be eligible for a Symbl.ai t-shirt as well!

Contributor Swag Form
Please fill out the Contributor Submissions Form once you have raised PRs for Hacktoberfest. We would love to ship you a swag!

Symbl.ai Developer Resources:

• GitHub
• Docs
• Postman Public Workspace
• Symbl.ai Slack Community

If you have any questions, don’t hesitate to reach out on Slack or tag any of our maintainers on any of the GitHub issues.

Maintainers – Vishal, Akanksha, Pema, Akanksha, Vaibhav, Jahnavi, Shivam, Rishabh, Neeraj

Connect with us and other developers

• Slack Group
• Twitter: @symbldotai and @SymblDev
• Github
• Akanksha Bhasin’s Twitter

Feel free to reach out to me, Akanksha Bhasin, your Symbl.ai Technical Community Evangelist and Advocate, if you are interested in learning more about our community or have general questions about Symbl.ai.

Happy Hacking! ✨

The post Hacktoberfest with Symbl.ai — Celebrate open source for a chance to win exclusive prizes! appeared first on Symbl.ai.

To celebrate our thriving Developer Community all across the Globe, join us in highlighting creativity, collaboration, and the continuous strive to innovate in speech and conversation intelligence. We will continue to launch a series of fun activities and opportunities to win cool prizes throughout the month of July to thank you and your fellow developer peers for the continued support and contributions to the Symbl.ai Dev Community.

How can you participate?

It’s super easy!! Check out the schedule below for the fun activities you may be interested in, make a note of the date and time, follow the instructions provided, and have fun! However, to qualify, you must first have a Symbl.ai account. Sign up for a free account here.

If you already have a Symbl.ai account, build with something with our APIs and showcase your projects, learnings and feel free to tag us or use the #SymblDevMonth hashtag along your journey; we would love to amplify your work!

Upcoming events in July

July 14: Meme Contest

A one week contest hosted on our #general Slack channel to unleash your creativity skills! You are free to use any meme generator to create cool memes related to programming and development. The contest will start on July 14th at 9 AM PST, and the results will be announced on July 21st. Top 5 submissions will receive exclusive Symbl.ai swag.

July 15: Hackathon Ideation Session 3: Transform

Get ready for a knowledge-based, hands-on session on July 15th, 9AM PST. In this session we will focus on one of our current hackathon themes: Transform. Transform voice or video conversations digitally into the next generation of artificially intelligent insights. Demo will be covering Extract Time-Series Analysis of Sentiments from Calls with Symbl.ai’s Python SDK, Pandas, & Matplotlib. Register Here.

July 26: Twitter Giveaway

A Twitter giveaway will run on Symbl.ai’s Twitter account on July 26th at 9 AM PST, and 3 lucky winners will be rewarded. Follow us on Twitter to stay updated – lots of cool swag coming your way, so stay tuned!

July 30: Happy Hours 

Happy hours are community connect sessions hosted for fun and to initiate engagement in the community. Join us on July 30th at 9 AM PST for the opportunity to network with folks all around the globe and build lifelong connections! Register Here.

Highlights from June

June 16: Twitter Giveaway 

We hosted a successful giveaway on June 17th, and 5 winners were awarded exclusive Symbl.ai t-shirts and stickers.

June 17: Symbl.ai 101 

Getting started with Symbl.ai on Postman and common integration and use cases were discussed.

June 22: Slack AMA

We are excited to launch Symbl.ai’s AMA series. We had our first guest – Toshish Jawale, co-founder and CTO of Symbl.ai. The AMA event was hosted on our #general channel on Slack, focusing on Conversation Intelligence 101.

June 24: Symbl.ai Visualize Session 

The audience was taught the basics of Symbl.ai as well as a demo was demonstrated on WebSockets and Real-Time Sentiment Analysis with Emojis. Watch here. 

June 25: Developer Spotlight Series 

We are really glad to announce the first ever Symbl.ai’s Developer Spotlight Series. We had our first guests with us – Team Tier 4 who recently won the Symbl.ai’s Track Prize in Hackon 2.0.

Connect with us and other developers

• Slack Group
• Twitter: @symbldotai and @SymblDev
• Github

Feel free to reach out to me, Akanksha Bhasin, your Symbl.ai Community advocate, if you are interested in learning more about our community, becoming a Symbl.ai ambassador, or have general questions about Symbl.ai.

• Email: akanksha.bhasin@symbl.ai
• Twitter: https://twitter.com/Akii_20
• Linkedin: https://www.linkedin.com/in/akankshabhasin

The post Announcing Symbl.ai Developer Month appeared first on Symbl.ai.