November 2017 - Esug-list - lists.esug.org

PhD IoT in France

by Stéphane Ducasse

Hello Description Over the last years, the RMOD team of INRIA Lille and the CAR theme of IMT Lille Douai have been working together on creating tiny language core. For example, Guillermo Polito demonstrated in his PhD a fully reflective kernel that fits into 80 kb of memory and that it is possible to have hyper specialized kernels down to 11 kb. We have also worked on remote debugging (PhD of N. Papoulias) and dynamic code updates (PhD of P. Tesone) of such kernels. All of these works are prototyped in Pharo. More recently, RMOD have been working on advanced probes mechanisms (M. Denker) and a solid remote debugging infrastructure (D. Krudiaskov). The goal of this PhD is to revisit the architecture around such mini-kernels for building IoT applicatons. The following tasks are foreseen : — improve the tools to : edit, compile, debug, deploy and update such kernels on IoT devices. Learning how to debug remotely and dynamically update such IoT systems using the PharmID Pharo environment. This task will be in cooperation with M. Denker and D. Krudiakov on remote debugging for IoT and G. Polito for the kernel edition and tooling, — define some language extensions to manage groups of IoT devices to program them at once. Managing hundreds or even thousands of IoT devices is a challenging task. We want to explore different solutions to help deploying and updating groups of IoT devices using some registration mechanism in a cloud server or some groups/roles based approaches for example, — expressing the architecture of IoT applications. We would like to explore also how to express IoT architectures and what are the abstractions that should be offered to developers such as expressing event-driven architectures with declarative ECA (Event-Conditions-Actions) rules. But we will study a couple of typical IoT appli- cations. — dynamically update an IoT application. An IoT application needs to adapt itself because unreachable or faulty devices or the diminution of available bandwith. We would like that the whole application can reconfigure itself in such situations as Guillaume Grondin proposes it in its PhD. — Lighweight virtual machines. Virtual machines in the IoT context are very powerful for incremental deployment or dynamic updates. Although they are tuned for speed,they consume space compared to a non VM-based program. In this task, we would like to investigate what is the minimal memory consumption that we can reach for a VM usable for IoT. To do so we will use a standard VM such as Cog (the open- source virtual machine of Pharo) and degrade it. We will use it since our minimal kernels are running on it. Note that ZweiDenker GmbH is interested in collaboration on the IoT management cloud infrastructure. Application To apply, please send us : — a CV, — a copy of your Master diploma — a copy of your Master thesis — 2 (two) reference letters, with the contact details of the referents — links to videos of demos of your experiments and/or simulations Prof. S. Ducasse stephane.ducasse(a)inria.fr. Email subject must start with : [PhD-RMoD- CAR-2017]. Bibliography — G Polito, St ́ephane Ducasse, N Bouraqadi, L Fabresse, M Mattone. Virtualization Support for Dynamic Core Library Update. Onward !, Oct 2015, Pittsburg, USA. — Guillermo Polito. Virtualization Support for Application Runtime Virtualization and Extension. Ph.D. Thesis 2015. Co-delivr ́ee par l’Universit ́e de Lille et l’E ́cole des Mines de Douai. — Extended results of Tornado : A Run-Fail-Grow approach for Dynamic Application Tayloring. Commanditeur : E ́cole des mines de Douai, France. 50p, July 2014 — Nick Papoulias, Noury Bouraqadi, Luc Fabresse, St ́ephane Ducasse and Marcus Denker, Mercury : Properties and Design of a Remote Debugging Solution using Reflection, Journal of Object Technology, 14, 1 :1-36, 2015 — Madcar:anabstractmodelfordynamicandautomatic(re-)assemblingofcomponent- based applications G Grondin, N Bouraqadi, L Vercouter. International Symposium on Component-Based Software Engineering, 360-367. -------------------------------------------- Stéphane Ducasse http://stephane.ducasse.free.fr http://www.synectique.eu / http://www.pharo.org 03 59 35 87 52 Assistant: Julie Jonas FAX 03 59 57 78 50 TEL 03 59 35 86 16 S. Ducasse - Inria 40, avenue Halley, Parc Scientifique de la Haute Borne, Bât.A, Park Plaza Villeneuve d'Ascq 59650 France

Nov. 14, 2017

Re: [Esug-list] To improve the quality of the ESUG videos

by Steven Kelly

NDI has Linux support; it’s just that they don’t make the prebuilt Tools download for it. The Linux SDK contains code for sending video, but not for screen capture. Before I’ve just sent done Linux screen capture with ffmpeg’s x11grab: http://ffmpeg.org/ffmpeg.html#X11-grabbing ffmpeg -f x11grab -video_size cif -framerate 25 -i :0.0 /tmp/out.mpg Rather than saving to a file, ffmpeg can also stream e.g. as an RTMP stream (that Livestream Studio, vMix and OBS can pick up): https://trac.ffmpeg.org/wiki/StreamingGuide E.g. from a Raspberry Pi’s camera, encoded in the Pi GPU to H.264 and sent by ffmpeg as a flv RTMP stream: raspivid -n -vf -hf -t 0 -w 960 -h 540 -fps 25 -b 500000 -o - | ffmpeg -i - -vcodec copy -an -metadata title="Streaming from raspberry pi camera" -f flv $RTMP_URL/$STREAM_KEY Looks like ffmpeg has now also implemented NDI: https://www.ffmpeg.org/ffmpeg-devices.html#libndi_005fnewtek-1 So presumably just merging the above commands to take the input from x11grab rather than piped from raspivid, and changing the output from flv to libndi_newtek $NDI_NAME would work on Linux. Steve From: David Mason [mailto:dmason@ryerson.ca] Sent: Wednesday, November 1, 2017 2:05 PM To: Steven Kelly Cc: Stéphane Ducasse; ESUG Mailing list Subject: Re: [Esug-list] To improve the quality of the ESUG videos NDI looks cool, except no Linux support, and quite a few ESUG presenters use Linux, if I remember correctly. On 31 October 2017 at 13:21, Steven Kelly <stevek(a)metacase.com<mailto:stevek@metacase.com>> wrote: Hi Stef, I’ve not used that particular capture card, but a few others certainly – from low end to high end, mostly for live streaming of cameras and PC screen. I use Livestream Producer and Livestream Studio for that, but they are more expensive that vMix and OBS Studio that I recommend below. That AV.io HD is pretty high end, but has the possible problem that there’s no video output, so you couldn’t put it directly between the presenter’s PC and projector. You’d need splitters for whatever inputs you might have from the PCs. One option may be if the projector has an output, generally VGA, and you could get the signal to capture from there, always in the same format regardless of the presenter’s PC. I haven’t tried that enough to know how much quality etc. varies. How are you recording currently, and with what products? - webcam? - An SD card in the camera? - A video cable from the camera to a video capture card on a PC? - Some computer video format sent by the camera to the PC via USB/IP? If you want to improve the videos, I’d suggest: - using the camera to film the speaker rather than the slides. The current camera is really suffering trying to record the screen, but contrast improves quite a bit when it occasionally films the speaker, e.g. here<https://youtu.be/lBxwaUvortA?t=8m26s>. - using a capture card as suggested to grab the projector input. - using something like vMix<https://www.vmix.com/purchase/> or OBS Studio<https://obsproject.com/> on a separate PC to take the audio and video inputs and mix them into a stream, which could go live to YouTube. (Not so much because I think ESUG should be live, but because it’s less time consuming to do the video mixing live at the conference, rather than having to mix and upload everything in the evening or after the conference.) An alternative approach: The cool way to do this these days is to use NDI<https://www.newtek.com/ndi> – a fast video codec, that in this case could capture the screen on the presenter’s PC (NDI Scan Converter<https://www.newtek.com/ndi/tools/>, simple install) and be picked up over the (preferably wired) network by the PC used to record the camera. Cost: $0, and no fiddling about with extra video cables. The downside is of course the install. Mind you, if you had the video PC connected to the projector, showing the presenter’s video output as it is received via NDI, that means you avoid the normal problems of trying to get each PC working with the projector. All the best, Steve From: Esug-list [mailto:esug-list-bounces@lists.esug.org<mailto:esug-list-bounces@lists.esug.org>] On Behalf Of Stéphane Ducasse Sent: Tuesday, October 31, 2017 5:02 PM To: ESUG Mailing list Subject: [Esug-list] To improve the quality of the ESUG videos Hello Smalltalk Friends We would like to improve the capture of screen for the I googled a bit after talking with peter uhnak and we could capture the screen output (on the way to the projector). https://www.amazon.com/AV-io-HD-video-capture-1080p/dp/B00ZH7HRKW?Subscript… I would like to know if one of you got experience with such devices. Stef -------------------------------------------- Stéphane Ducasse http://stephane.ducasse.free.fr http://www.synectique.eu / http://www.pharo.org 03 59 35 87 52 Assistant: Julie Jonas FAX 03 59 57 78 50 TEL 03 59 35 86 16 S. Ducasse - Inria 40, avenue Halley, Parc Scientifique de la Haute Borne, Bât.A, Park Plaza Villeneuve d'Ascq 59650 France _______________________________________________ Esug-list mailing list Esug-list(a)lists.esug.org<mailto:Esug-list@lists.esug.org> http://lists.esug.org/mailman/listinfo/esug-list_lists.esug.org

Nov. 1, 2017

Re: [Esug-list] To improve the quality of the ESUG videos

by David Mason

NDI looks cool, except no Linux support, and quite a few ESUG presenters use Linux, if I remember correctly. On 31 October 2017 at 13:21, Steven Kelly <stevek(a)metacase.com> wrote: > Hi Stef, > > > > I’ve not used that particular capture card, but a few others certainly – > from low end to high end, mostly for live streaming of cameras and PC > screen. I use Livestream Producer and Livestream Studio for that, but they > are more expensive that vMix and OBS Studio that I recommend below. > > > > That AV.io HD is pretty high end, but has the possible problem that > there’s no video output, so you couldn’t put it directly between the > presenter’s PC and projector. You’d need splitters for whatever inputs you > might have from the PCs. One option may be if the projector has an output, > generally VGA, and you could get the signal to capture from there, always > in the same format regardless of the presenter’s PC. I haven’t tried that > enough to know how much quality etc. varies. > > > > How are you recording currently, and with what products? > > - webcam? > > - An SD card in the camera? > > - A video cable from the camera to a video capture card on a PC? > > - Some computer video format sent by the camera to the PC via > USB/IP? > > > > If you want to improve the videos, I’d suggest: > > - using the camera to film the speaker rather than the slides. > The current camera is really suffering trying to record the screen, but > contrast improves quite a bit when it occasionally films the speaker, e.g. > here <https://youtu.be/lBxwaUvortA?t=8m26s>. > > - using a capture card as suggested to grab the projector input. > > - using something like vMix <https://www.vmix.com/purchase/> or OBS > Studio <https://obsproject.com/> on a separate PC to take the audio and > video inputs and mix them into a stream, which could go live to YouTube. > (Not so much because I think ESUG should be live, but because it’s less > time consuming to do the video mixing live at the conference, rather than > having to mix and upload everything in the evening or after the conference.) > > An alternative approach: The cool way to do this these days is to use NDI > <https://www.newtek.com/ndi> – a fast video codec, that in this case > could capture the screen on the presenter’s PC (NDI Scan Converter > <https://www.newtek.com/ndi/tools/>, simple install) and be picked up > over the (preferably wired) network by the PC used to record the camera. > Cost: $0, and no fiddling about with extra video cables. The downside is of > course the install. Mind you, if you had the video PC connected to the > projector, showing the presenter’s video output as it is received via NDI, > that means you avoid the normal problems of trying to get each PC working > with the projector. > > > > All the best, > > Steve > > > > > > *From:* Esug-list [mailto:esug-list-bounces@lists.esug.org] *On Behalf Of > *Stéphane Ducasse > *Sent:* Tuesday, October 31, 2017 5:02 PM > *To:* ESUG Mailing list > *Subject:* [Esug-list] To improve the quality of the ESUG videos > > > > Hello Smalltalk Friends > > > > We would like to improve the capture of screen for the > > > > I googled a bit after talking with peter uhnak and we could capture the > screen output (on the way to the > > projector). > > > > https://www.amazon.com/AV-io-HD-video-capture-1080p/dp/ > B00ZH7HRKW?SubscriptionId=AKIAILSHYYTFIVPWUY6Q&tag= > duckduckgo-osx-20&linkCode=xm2&camp=2025&creative=165953& > creativeASIN=B00ZH7HRKW > > > > I would like to know if one of you got experience with such devices. > > > > Stef > > > > -------------------------------------------- > > Stéphane Ducasse > > http://stephane.ducasse.free.fr > > http://www.synectique.eu / http://www.pharo.org > > 03 59 35 87 52 > > Assistant: Julie Jonas > > FAX 03 59 57 78 50 > > TEL 03 59 35 86 16 > > S. Ducasse - Inria > > 40, avenue Halley, > > Parc Scientifique de la Haute Borne, Bât.A, Park Plaza > > Villeneuve d'Ascq 59650 > > France > > > > _______________________________________________ > Esug-list mailing list > Esug-list(a)lists.esug.org > http://lists.esug.org/mailman/listinfo/esug-list_lists.esug.org > >

Nov. 1, 2017