Audio/Video conversation

[Fabioamd87]

is possible to split this support posts and leave this tread for devs communication?

[kakaroto]

As per fabio's suggestion, the thread was split, for support questions, use this thread instead :
http://www.amsn-project.net/forums/viewtopic.php?t=5175
thx

[kakaroto]

Hello hello everyone..
long time no see!
Well, I'm posting here to give you a little update on my progress...
good news! I have just finished making libnice MSN compatible... This basically means that we can now have ICE support with aMSN so you can always have the audio conversation working, whether it is with another WLM user, or with aMSN, whether the user is behind a NAT/firewall or not...
you will need the 'nice-kakaroto' branch of libnice from GIT : http://git.collabora.co.uk/?p=user/kakaroto/nice.git;a=shortlog;h=refs/heads/nice-kakaroto
then you will need the 'nice' branch of farsight 2 from GIT : http://git.collabora.co.uk/?p=user/tester/farsight2.git;a=shortlog;h=refs/heads/nice
Then you will need the changes I have locally on my laptop.. LOL.. yeah, I wanted to commit that, but SVN is down for today, so tomorrow it should be fixed, and I'll commit my changes...

Anyways, my previous TODO (on page 3:p) was :

TODO :
1 - use of ICE for having WLM receive our stream
2 - add a Siren encoder/decode/payloader/depayloader for gstreamer
3 - clean the ugly hacky functions I used for testing...
4 - a proper configure/makefile/runtime dependency check...
5 - a proper UI

So I'm glad to say that '1' is finally DONE!!
the 2, 3, 4 and 5 were already done... so the TODO is finished... oh well, not exactly..

here's the new TODO :
1 - Handle the SIP re-invite with the remote-candidate chosen by the controlling endpoint
2 - send the SIP re-invite when we are in controlling mode and we elect a candidate pair
3 - add support for TURN
4 - make the 'farsight' application currently used, as a Tcl extension (we don't need glib main loop anymore with farsight) and use a tcl API to get farsight running
5 - Remove debug output from libnice and libstun
6 - release libnice
7 - release farsight2

OK, so 1 and 2 should be done tomorrow, pretty simple, I just need to do it...  
3 will be hard, but I reverse engineered most of it, and the only remaining part is implementing it in libnice.. unfortunately, it will require a lot of refactoring since libnice wasn't written for that... thankfully though, it's the same protocol specifications as the google relay, and I am paid to implement google relay support in libnice for my job, so it will be done eventually (hopefully in the next 2 weeks).
4 will be the tricky one since farsight2/gstreamer uses a huge amount of threads and I will need to make the extension thread-safe to avoid crashing Tcl.
5 is simple, in my TODO list, might be done tomorrow
6 and 7 were planned for this week, so expect them soon.. (maybe for next week or in two weeks, depending on some other stuff...)

Bad news (for you guys :p). I will be leaving town/country/continent/not-planet in about 10 days.. and I'll be gone for one month, so I will most probably (for sure) not do any code in that time... You should get a working thingy before then, but the TODO might not be finished by then...
Once this TODO is finished, we can put the "audio conference" feature as 100% complete.. all that will remain is testing it, using it, bugfixing it.

I'll let you know when everything is in SVN and when you can start trying it out!
see you!

[muratasenel]

Kakaroto, you are GREAT!

Uhm, before start testing, I just want to make sure that those git repo addresses are correct?

git://git.collabora.co.uk/git/user/kakaroto/nice.git for nice
git://git.collabora.co.uk/git/user/tester/farsight2.git for farsight2 with nice

Murat

[kakaroto]

thx!
yes, once you do the 'git clone', you must do a 'git checkout <branch>' to change to the branch that contains the code you want..
so..

Code:

git clone git://git.collabora.co.uk/git/user/kakaroto/nice.git libnice
cd libnice
git checkout nice-kakaroto
cd ..
git clone git://git.collabora.co.uk/git/user/tester/farsight2.git  farsight2
cd farsight2
git checkout nice

btw, I also committed my changes to SVN... I'm working on making this more complete and a real tcl extension!

[muratasenel]

git checkout nice-kakaroto doesn't work
murat@infidel libnice $ git checkout nice-kakaroto
error: pathspec 'nice-kakaroto' did not match any file(s) known to git.

Also, same for farsight2. :\

[kakaroto]

humm.. it's actually 'git checkout origin/nice-kakaroto'
and for farsight2, check the git website, the branch name is now 'nice-rebased-30-07-2008'
be a little bit more patient, I'm working on the tcl extension for this...

[bigbadben]

humm.. it's actually 'git checkout origin/nice-kakaroto'
and for farsight2, check the git website, the branch name is now 'nice-rebased-30-07-2008'
be a little bit more patient, I'm working on the tcl extension for this...

merçi beaucoup pour ton dur travail accomplie j'usqu'a présent.

[kakaroto]

Hello friends...

here's the new TODO :
1 - Handle the SIP re-invite with the remote-candidate chosen by the controlling endpoint
2 - send the SIP re-invite when we are in controlling mode and we elect a candidate pair
3 - add support for TURN
4 - make the 'farsight' application currently used, as a Tcl extension (we don't need glib main loop anymore with farsight) and use a tcl API to get farsight running
5 - Remove debug output from libnice and libstun
6 - release libnice
7 - release farsight2

1 - DONE
2 - DONE
3 - nooooo, not yet (but mostly not needed)
4 - DONE
5 - half done
6 - next week
7 - probably next week too...

so, basically, it will now all work correctly.. it's not a half-finished job anymore (it's not well tested though.. it's almost 4AM now!!!)
so... just follow the instructions and try it out!

Audio conferences should now be stable and should work correctly between amsn<->amsn and amsn<->WLM... whether you are firewalled or not, behind a NAT or not, on the same network or not, etc...
I'll be waiting for your reviews/comments/test results!

p.s.: I'm updating http://amsn-project.net/wiki/Farsight so make sure to check the new requirements!!!!

[why.arent.guests.allowed]

so that means.... that means... that means the work on bi-directional audio-video sessions can start after your vacations!!!!
That is my #1 wished feature.


Have fun during your vacations!
Where are you heading?

[muratasenel]

Hi,

I just checked the wiki page and I think some corrections should be made.

The clone and checkout process should be like this:

Code:

git clone git://git.collabora.co.uk/git/user/kakaroto/nice.git libnice
cd libnice
git branch kakaroto origin/nice-kakaroto
git checkout -f kakaroto

cd ..

git clone git://git.collabora.co.uk/git/user/tester/farsight2.git  farsight2
cd farsight2
git branch tester origin/nice-rebased-30-07-2008
git checkout -f nice-rebased-30-07-2008

I didn't do any changes on the wiki since I could be wrong or even I don't have enough permission to do any changes on the wiki.  : )

[kakaroto]

@why.arent.guests.allowed : congratulations on becoming power user!
and no, the bidirectional audio-video will not be for now.. it is also a VERY BAD design (not ours, the protocol).. so the best you could every do is do this audio conversation then do a separate webcam session!

and thanks, I'll be in Morocco for a month.

@muratasenel : humm.. maybe, but no need to make a local branch, I just updated the wiki, instead of "git checkout nice-kakaroto" it should be "git checkout origin/nice-kakaroto". Thanks for noticing!
anyone had a chance to test this yet (I can't anymore, my laptop has 1% battery left and forgot the charger at work... that's why I stopped coding yesterday, lol :p) ?

[why.arent.guests.allowed]

@why.arent.guests.allowed : congratulations on becoming power user!

I'm more of a power spammer or annoyer...  :roll: heheh

and no, the bidirectional audio-video will not be for now.. it is also a VERY BAD design (not ours, the protocol)..

Not sure if I understood you. I wasn't expecting it (as you said) "for now", but I also said  "the work ... can start *after* your vacations".
So does that mean you will never work on bidirectional audio-video **or** that you will work on it (even if not immediatly after your vacations)

so the best you could every do is do this audio conversation then do a separate webcam session!

So I can start and record a bi-directional audio session, while simultaneously starting 2 webcam sessions (one receiving and the other sending)

and thanks, I'll be in Morocco for a month.

Watch out there... I heard they sell some funny-smoking stuff there... bahhh... they sell it everywhere now...  :lol:

[kakaroto]

Not sure if I understood you. I wasn't expecting it (as you said) "for now", but I also said "the work ... can start *after* your vacations".
So does that mean you will never work on bidirectional audio-video **or** that you will work on it (even if not immediatly after your vacations)

yeah.. I don't know if I'll continue working on it.. once the libao project (GSoc) is done, we can hopefully implement the send/receive for audio with reception of video.. I was able to make ffmpeg encode video for sending correctly but the quality is REALLY bad, so I don't know about that.. maybe some ffmpeg guru can fix that quite easily (the keyframe is good, subsequent frames not that much, so we need to make it write a keyframe for each frame... bad for bandwidth but good for quality and no other choice right now... )

So I can start and record a bi-directional audio session, while simultaneously starting 2 webcam sessions (one receiving and the other sending)

sure! there's nothing preventing you from doing that...

Watch out there... I heard they sell some funny-smoking stuff there... bahhh... they sell it everywhere now...

lol, no worries.. I'm Moroccan btw :p and yeah, we do have the best 'funny-smoking stuff' in the world

[muratasenel]

anyone had a chance to test this yet (I can't anymore, my laptop has 1% battery left and forgot the charger at work... that's why I stopped coding yesterday, lol :p) ?

Yep, I tried but after all, even amsn can detect farsight in ./configure and creates necessary libs as intended, it cannot detect farsight in amsn settings menu.
I can't figure out what is wrong and I beleive I meet all requirements mentioned in the wiki.