Wingman AI is OUT NOW! Check it out at kzread.info/dash/bejne/ppmhrsWjdqfPhrg.html

It's been awesome to a part of this project so far, the devs are super responsive and Wingman is showing real improvement. Keep it up guys!

Nice. There's an NPC LLM that uses facial recognition of the in game characters so you can also have conversations with the NPCs and develop a relationship with them. Works with any game. Definitely something to check out too.

@YoungMoneyFuture

Ай бұрын

Would be nice if you could tell us which llm it is

AI wingmen are an absolute must and they must level up over time. This brings in a sorely needed rpg Element.

This has been SO much fun to test!

I have a suggestion: it would be cool to be able to ask my co-pilot what time it is on specific POIs on far away planets or moon. Or even better, what time it will be when I arrive at that POI. There are projects out there that calculate this. Something you can integrate with your solution hopefully.

@sirnacly

7 ай бұрын

if the service has an API, then it should be pretty easily integrated using gpt's function calling capabilities!

This should be getting so much more attention, actually massive!

This is actually a much more realistic thing i would expect for the future.

The ATC take off sequence is awesome, saves so many damn keybinds

Amazing guys. Thank you for your dedication team.

Voice attack on steroids

To boldly go... 🤘🏻

amazing stuff, cant wait

Nice work!

Can't wait to test this out, danke

Great stuff👍

NICE, new update! Keep it coming :p

Einfach nur Danke an euch für die Arbeit. Danke

Is there any way to use your own trained TTS? or does it have to use another api of a text to speech website service?

I am honestly excited to try this out

Wow das wird immer besser!

Very exciting stuff :)

Gamechanger - amazing. Thank you so much

Good work :)

What’s your experience with function calling and tool utilisation been like? Any particular scenarios where consistency is not 100%?

@ShipBit

7 ай бұрын

Yes, sure. It's not 100% but pretty consistent. Even gpt-3.5 is good enough for simple functions but for the more complex one like StarHead API call with 3 params you definitely need gpt-4. The whole thing feels very "magical" and we are really amazed by it.

A dream comes true 🙂

I CANT WAIT!!!

Whats the difference between this and a keybind or sometimes macro, besides relying on voice?

Yet HDMS-Hadley do not even sell Corundum. But pfff.. details...?

Hear JSON model helped since coming out?

So cool.

when can we get this?

It's just so slow, though. I'm interested from the POV of immersion, but in all cases in this video it's at least 3 times faster to just press the keyboard key. For example at 2:22 it took over 6 seconds to respond, whereas you can just press 'I' and 'L' in about 0.5 seconds.

Pretty cool. Most of this is like the old 'voice attack' app from back in 2015. It just responds to spoken key words and executes macros. It's the player's choice how much they want to speak as long as they include those keywords. The player also can type in the responses they want from the program to their keywords. A great addition here is the ability to make API calls! Being able to query a trade route based on ship type and location will be great, as long as those trading APIs are kept up to date. I'm wondering where the "AI" part comes in though? Is that the multi-lingual ability or does the user need to pre-fill those responses as well?

@ShipBit

7 ай бұрын

@PerplexedVet We recommend you rewatch the 3 Wingman videos. There is a LOT more to it than "just voice commands" and API calls. Our upcoming release video might also shed more light on that.

@franciscomagalhaes7457

7 ай бұрын

@@ShipBit I guess your repository is still private, but I'm really interested about how you get the AI to interact with the other application. Like, do both the AI and the application need specific APIs? And what do you mean, "no GPT used" towards the end of the video? This is what video games need. And I'm extremely interested in its potential applications in diy robotics too. Can't wait for the release video!

Are you aware of the pre-existing wingman[DOT]ai project? Could be some troublesome trademark issues there. Especially since that project has ties to the UK Ministry of Defence. [Edit becausxe YT deleted the link to the project.]

Is it possible to beta test the product? I'd love to contribute. Currently flying with triple monitors, gaming seat and tobi eye tracker. Would love to test the immersion

this is the best thing since sliced bread

will it ever be able to target and shoot ships from a turret?

@Fluke2SS

7 ай бұрын

No there are in game NPC's for that or planned to be. But that doesn't mean you can't tie in a verbal chat AI into each NPC that is in the turret. Get real time reactions if they destroy something for example.

@FuriousImp

7 ай бұрын

NPCs aren't a thing yet. Won't be for a long while I think!

Moin zusammen, das eröffnet ja ungeahnte Möglichkeiten. Danke dafür. Habe ich es richtig verstanden, dass die einzige und auch kostenpflichtige Hürde die api-Anbindung zu openAI ist?

@ShipBit

7 ай бұрын

@milk4chillout Korrekt! Und optional 11Labs, falls du das benutzen möchtest, z.B. für Voice Cloning. Wingman AI ist kostenlos.

Any chance allowing us to change the text to speech voices from what you're using to ones from Elevenlabs using their API?

@ShipBit

7 ай бұрын

@JadeStarwatcher Yes, 11Labs is ready and will be in the release version!

@JadeStarwatcher

7 ай бұрын

@@ShipBit OMG you are awesome! Not all heroes wear capes!

So how much does this cost to start and keep running? Looking to start but i cant get a clear pricing from all the OpenAPI stuff needed as well.

@ShipBit

6 ай бұрын

You can become a Patreon for $5 and help us test our Azure infrastructure unlimited for the time being (but not forever) with our special Christmas Edition. With this setup you can use everything we have, except 11Labs and don’t have to create a single API key etc.

Where is it getting trade route information from?

@ShipBit

7 ай бұрын

@RobinHeartJones it's using the starhead.de/ API. There are already other community-based API calls in the making, for example uexcorp.

I like this. Can it plot a journey for you.

So it's like voice attack? It's not really an AI wingman, it's more of an AI assistant. I'd like an actual AI wingman or AI gunner that can control a second account on a 2nd PC.

Awesome, you can count me in! My AI knowledge is limited to chatGPT only, so you know what would be cool? If you could ask your wingman AI to play music. Thx guys!

@ShipBit

7 ай бұрын

That is totally possible with a custom Wingman that calls the Spotify API, plays local sound files from your hard drive etc. It's all just Python code.

I have no knowledge of programming or coding... How hard is this for the average person to set up? This would be amazing in Star Citizen!

@ShipBit

7 ай бұрын

Currently it's editing this very indentation-sensitive but well-documented config file we're showing in the video. We are working on a GUI that will make this much easier and we have a very friendly Discord community sharing their configs and helping people out.

So it is like voice attack but with massive lag added.

@SamierRN

7 ай бұрын

Sort of except it can search information online for you without you needing multiple websites open. Also, if you watched the part about instant commands, it’s not faster than voice attack. Immersion is what this is aimed for, it’s not aimed for “fast” which sometimes the world needs to slow down a bit. And frankly, later going fast isn’t going to end well in this game with death of a spaceman. Cannot wait for that.

This is really cool. Like genienely helpful, but I'm just hoping it won't randomly give a cringe line like the "We are doomed anyway" it said while in a calm cruise through atmo

You will do for Star Citizen what they themselves weren't sure they could do...Having a high functioning NPC will really be groundbreaking in gaming as a whole. Being able to talk sh*t to an enemy while in a firefight, plan with a NPC on your ship or simpyl chat and receive logical responses. I know you're not there yet, but you will be...And when you are, it'll change the way we look at and handle NPC's forever.

Yes FINALY i can say: EXECUTE ORDER 66 ! :DD

If RSI haven't called you yet to offer you a contract then artificial intellience already far exceeds their own!

Can't Using this get you banned?

CAN THE IA USE A TURRET ?!

@SamierRN

7 ай бұрын

I think a lot of people have a misconception of what this is. This is not an “AI NPC” that will control things by itself on your ship. This is a companion, such as voice attack. It will allow you to do things as the pilot of the ship that you would normally push a key for. It’s for immersion. It’s also set to eliminate having to open websites to find information you need. But I have to stress, this is not a NPC. That is something CIG is working on and not this, please refer to citizen con 2023 to see the npc information.

When i can do it without pressing a record button im interested.

@ShipBit

7 ай бұрын

@Pernicuz We're working on it but it won't be in the release version.

Hopefully Easy AntiCheat from Star Citizen doesn't bann Accounts.

@dipeyes

7 ай бұрын

That's what I thought too😂

@DERTOBL

7 ай бұрын

Does it ban VoiceAttack? No. This should be very fine. Still waiting for SCs API thou, making things a lot easier.

I really hope CIG sees what your doing and reaches out to collaborate formally at some point I'd love to just chat with NPCs about the verse and the SC lore, if they could integrate your system into a discrete secure lore based database for the NPC code to draw off.....it would be absolutely Wunderbar!

@Biggiejohn

7 ай бұрын

This seems like an inferior version compared to the established voice attack software. If you ever wanted William Shatner to deploy your landing gear and flip on your head lights Voice attack is it. Though I don't think voice commands are worth it if you have enough button inputs. Voice commands are generally slower as seen in the video than just pushing the buttons yourself. You will mainly default to just requesting landing gear up/down and docking requests with headlights on and off and power shifting. I don't think generic dialogue adds anything extra when you are wanting a command inputted in a timely manner. The trade route request info was handy though.

@ShipBit

7 ай бұрын

@Biggiejohn If you're only interested in low latency, then VoiceAttack might be the better choice for you at the moment. We already have "instant commands" that skip a lot of the GPT processing and significantly lower the response time to about 1.2s on average. This hasn't been our dev focus, though and it can and will be quicker than that in the future. You can also combine VoiceAttack and Wingman and there are already several community members doing that. They run both tools in parallel, use Voice Attack for performance-critical 1:1 commands and Wingman for more elaborate interactions. You can also start/stop Wingman with Voice Attack etc.

@Citizen-Nurseman

7 ай бұрын

@@Biggiejohn I'm watching this project more for the AI lore friendly conversational aspect rather than as a game control tool :)

as a competitive gamer most of what was shown here is not effecient for me at all BUT if i can say things like "turn engines off everytime i land" or things like "if i have a clear shot an they do not give full power to guns" or "if im a sitting duck give full power to shields" i like to play for 15 hours at a time and i prefer to be sitting up in my chair highly active and engaged and so i would really need it to not be in my way but to save me time an make things efficient. i need it to be what i would be if i was a wingman. but i also wonder about animation canceling because the ai is doing an action and i have to wait for my animation to finish sort of thing. i also wonder about other games where im playing among the top 1% of players if theres a way it could actually help like in apex legends if it would ping where the last circle is going to be so that i dont have to pull up my map this is somthing you can figure out yourself so its not cheating but it is getting sort of around that area BUT i would also argue about gaming montors wich play a gigantic role when you are playing a competitive game at the highest lvl like the switch from 60 hz monitor to 240 wich is absalutley mandatory if you are trying to do all you can. very interesting stuff coming out in this regaurd... VERY sad though that gaming is at an all time low but there is hope.

Too bad I was hoping for a tutorial on how to install it,

This looks super exciting for the solo player., Is there a way to? Habit be a secondary turret. One of my big issues is. I need a turret gutter. I have a secondary account. Is there a way to merge this with ai

@keirvr3318

7 ай бұрын

No

@Brokenfang77

7 ай бұрын

@@keirvr3318 Are you sure because that first statement sounded like somebody with an addiction?, And that's what somebody who was addicted to would say.....lol

@derbybOyzZ

7 ай бұрын

The Devs will be implementing NPCs you can hire for this. What you are describing would be akin to aim hacking with ai vision instead of what this is which is triggering keybinds

@Brokenfang77

7 ай бұрын

@@derbybOyzZ I don't know if it is considered an aim hack. I would argue if it fulfills a role. That the Debs are going to do anyways. And you could communicate with your. Turret gunner Through voice commands, It's an entirely different experience than using a Aint bought for your play through. I'm not suggesting that chat g d p affect my performance. Just a third party managing a turret on the ship. And as far as the devs go, Let's be honest about promised features. I'll probably die from old age and get my AARP card before some of these features get Enacte.. People have literally died of old age waiting For promised features. Plus if chat GDP could do a good job, it could set the standard and the expectation on what Stars that is in should implement.

@keirvr3318

7 ай бұрын

Huh? I said 'No', because what you're describing is not possible at all. The ai they have is for key bindings or API calls for stuff like trade routoes. They don't have the access or ability for the AI to take control of another player and be your gunner. And it won't be possible. @@Brokenfang77

For those that think this will be a NPC for your solo play, please understand what wingman means. The wingman's role is to support aerial combat by making a flight both safer and more capable: amplifying situational awareness, increasing firepower, and allowing more dynamic tactics. It does not take the role of a gunner. They are essentially your co-pilot. In traditional form, the wingman was a pilot in another ship behind you in formation. So think of this as a compliment to voice attack with more functionality and way more immersive experiences than voice attacks scripted voice over options. Personally, I’ll be using this when I want to dive into the world and pretend. Otherwise, my HOSAS has all my keybinds and I’ll react faster than speaking what I need done.

@Fluke2SS

7 ай бұрын

It ain't rocket scient bruh: Use wingman for tedious work, such as ATC take off and landing procedures, or Trade Routes. Use keybinds when speed is required. Either way it is a viable concept and will work in SC. It will work especially well for Explorers, long trips, QT. I can keep going, but I think you get my point.

@SamierRN

7 ай бұрын

@@Fluke2SS As I mentioned, immersion is WONDERFUL, but my hosas (with JoyToKey) can do all this already (without delay), and so can VoiceAttack. I am not saying this isn't a good concept; I am all for it and want it myself for trading, but it is for others who want to use this as an "NPC" or as a bot to man their turrets; that is where I draw the line. Again, wonderful concept, I look forward to using it myself because I love all the immersion, and cannot wait to see what else comes from this.

Interesting, but this could cause issues with people abusing best routs and allow people to cheat….

@sauceless6666

7 ай бұрын

there are already 3rd party sites that give you the same info, all this program does is connect with the api and say it out loud instead of you having to look at it on another monitor. Still i'm sure it could be abused but not anymore then other 3rd party things

I will pay for premium if you guys go far enough. the A.I part has to be a tad faster to really be usefull.. If they dont nerf this app in some nice functions I will buy it.. But if they do Voice attack is still better and ultra fast.

Nice work!