Saturday, March 30, 2019

Smartphone VFD-300 as an Infra-Red Camera by removing the IR-cut filter

Experimenting here is done with a Vodafone VFD-300 which appears to be a typical example of low cost smartphones. Vodafone have now replaced this model with the VFD-320 which appears to be physically similar but I have not had the opportunity to test one yet.

The VFD-300 can be converted to an effective Infra-Red camera by removing the "IR-cut filter"
The IR-cut filter is a thin glass or brittle plastic object at the back of the lens which blocks infra-red light.

Remove the device back cover.
Then take out screws to remove an internal plastic cover.
The camera is centre-top.

The lens unscrews. 
Hint: Count how many turns or part-turns to remove the lens. It will need to go back the same way to have focus. I counted 10 part turns which approx translates to 3 full turns.

Lens with IR-cut filter is on the left.
At some angles, reflected light looks red.

Lens on the right has had the IR-cut filter removed.


The IR-cut filter breaks easily by a light touch with a sharp metal object. Best to do this working in an open plastic container to catch the resulting very small pieces of broken .. glass? We can then clean it out with a wet paper towel or similar.

Removing the IR-cut filter makes a big difference in camera behaviour.
Interesting to see here that a dark red chair becomes one of the brightest objects in infra-red.


A modest IR LED light source gives IR vision up to 8m

The camera has a low light setting which appears to give a slow shutter speed, resulting in motion blur. I intend not to use that because of monitoring animals like rats where we do not want motion blur. Also we are likely to monitor at close distances of 1m to 2m and it looks like our infra-red lighting levels will be good enough to work well at the "normal" setting. With enough headroom to be able to run a lower power LED infra red light source.
Here for interest is the same shot taken on the low light setting.

The camera gains increased sensitivity for low levels of visible light, although with false colour in the image. I had 2 x VFD-300 phones available last night, one with this mod and one with a "normal" camera. So I could take photos of a back yard in fading evening light, both ways.

"Normal" camera:

IR-cut-filter removed.

"Normal" camera

IR-cut filter removed:





Monday, March 25, 2019

Snake Robot does Dancing in the Dark

This relates to efforts to save NZ native bird life from introduced predators like rats, possums and stoats which are a mis-match to our ecology.

There is a story going around the internet about snake robots. Here is the wikipedia version:
Also, snakebots can be used by animal control officers to subdue rabid or invasive creatures. Raccoons, barn cats, and large rodents typically respond to the snakebot's presence with attacks upon which the snakebot will emit an electrical shock and paralyze the aggressor. (retrieved from: https://en.wikipedia.org/wiki/Snakebot)
 The sources, which include at least 1 academic journal article:
(http://ijetsr.com/images/short_pdf/1522048019_1217-1222-oucip927_ijetsr.pdf)
appear to be quoting each other. I can find no first hand experience stories or other evidence for this.

There are 3 claims here:
  1. "snakebots can be used by animal control officers"
    Snake Robots are highly experimental and there may be only 10 in the world at the time of writing this - March 2019. They are not readily available to anyone except researchers and advanced hobbyists who build their own.
       
  2. "(pests) respond to the snakebot's presence with attacks"
    If there is any truth in this then it would give snake robots an important pest control "lure" advantage. Therefore IMO it is worth finding out.
      
  3.  "emit an electrical shock and paralyze the aggressor"
    Electric shock is used in some commercially sold rat traps so this may work.
Focussing on (2), can a snake robot attract pest attention? If this is an instinct for some animals, would they still have it after many generations in NZ with no contact with snakes? I am a practical person so late at night on the 16 Mar 2019, I was out in the bush with my snake robot and equipment to try to find out.
In brief: The result is inconclusive. No predators attracted but I was only able to get the snake robot running alone for 10 minutes.

Lots of problem-solving to get out there. It was a close decision to go ahead but it was good value as discovery of what the snake robot needs to do better.

Note - I am describing and naming products that worked well in this particular situation. I have no promo connection with their makers or sellers.

Where to put the Snake Robot?
I had access to a bush area north of Auckland. I found a dried up creek with a waterhole and I selected an earth bank above that as a good area. Later I got advice from a local farm manager who recommended the same place. I placed a "Trail Camera" there 2 weeks before the grand experiment and results from that showed possum activity. Here is the reconnaissance highlights video:



A Snake Robot needs Snake Skin
Showing off the snake workings has been good value for public demos, but it will not do for out in the bush. I asked my daughters about hosiery and they recommended heavy opaque pantyhose. Well done! I can report that "Columbine 50 denier (heavy) opaque pantyhose Mocha small" that I bought from the Farmers Trading Company was good value for both flexibility and protection.



Monitoring Cameras
The "TechView 720P Outdoor Trail Camera" bought from "JayCar" - NZ 169.00  Cat.no: QC8041 - had a success rate of 19 out of 26 trigger events in 2 weeks, ie 73 percent which is better than I expected. I set up its timer to record from 6:30pm to 6:30am ie at night with a little evening and morning. The highlights video above is from this camera.

I bought and assembled an "Infra-Red Spotlight Kit"  NZD 10.14 on special from "JayCar". Cat.no: KG9068. I modified it to run from a 5V powerbank through a boost module giving 9V. That needed use of 47 ohm resistors instead of the supplied 220 ohm. This gave me the opportunity to measure the efficiency of a boost module. Input is 5V x 1.1 A = 5.5W. Output running the 32 leds is 9V x 0.5A = 4.5 W. Efficiency = 4.5/5.5 = 0.82 (82 percent).

This "spotlight" did well at adding more infra red illumination, especially for the next item.

I dragged out an old Sony Handicam Video Camera of circa 2001 vintage. At that time Sony used CCD sensors which have good infra-red sensitivity and they had a "Nightshot" setting including an infra-red spotlight. Similar result to a trail camera but with the advantage of an optical zoom lens. I positioned myself 25m away and used this as my night vision to watch the test site.

SmartPhone as infrared monitoring camera?
In earlier trials at home I found 2 x smartphones that appeared to have some infrared sensitivity. This suggested the possibility of a wildlife monitoring camera with remote monitoring capability. However in these real bush conditions they were not sensitive enough. I have since tried finding and removing the "infra red cut filter" on an old phone but that only resulted in my breaking the camera. [UPDATE 30 Mar 2019 - tried this again on a Vodafone VFD-300  - found the infra-red-cut-filter in the back of the lens, broke it out and ... success - it is now an effective infra red camera. It has also gained increased sensitivity as a visible light camera although with false colours.  New blog post about this:
  http://hitechfromlotech.blogspot.com/2019/03/smartphone-vfd-300-as-infra-red-camera.html]


Needs remote control
I was watching from behind a large tree about 25m away from the snake. That was too far for remote control by bluetooth which was losing contact at only about 7m so I had the snake idling which gives a small "jiggle" movement. On the TODO list is to combine our open source software projects "XMSnakeRobot" and "XMRemoteRobot" to give long distance remote control over mobile data. As in run the snake robot and cameras from the farm house, which would get me well away from target animals which may want to avoid me.  I have made good progress on that in the last week.

Snake Robot needs an external power supply for this experiment
The snake robot runs on internal model aircraft lithium batteries which give it independent untethered movement - this seems to be a rare capability for existing snake robots. Sessions are limited to about 45 min indoors."In the wild" it only ran 10 min before the back battery ran out - I think the tail hit some real life outdoor resistance like digging into the dirt. I did try running from a "powerbank" but the current draw had peaks that were too high, often triggering the powerbank cutout. On the TODO list is to try running from 2 x powerbanks which may work because the front and rear halves of this snake robot are powered separately.

Photos

Target area with trail camera:

Snake Robot setup as seen by the trail camera


"Oldie but a goodie" - old Sony Handicam has infrared "nightshot". 

John Calder (author), with snake robot and important support equipment, navigating past cattle.

Friday, March 8, 2019

Raspberry Pi and Rasbian OS disappointing result. TODO try Windows 10 IOT.

My common robotics architecture is:
Android Smartphone in the role of "Robot Brain" communicating via Bluetooth to Arduino MicroControllers in the role of "Spinal Cord".
I have done some experimentation with a "Raspberry Pi Zero" as an alternative "Robot Brain" and I revisited that today. I have setup and run the "Pi" for remote-control with VNC using "Pi Bakery":
https://www.pibakery.org/
which I have found to be excellent value. "Pi Bakery" installs "Rasbian" which is "Linux Debian" customised for "Pi". "Pi Bakery" includes additional customisation to get Pi to begin running by remote-control over WiFi or over a USB cable. No screen or keyboard required - Pi borrows your computer or laptop screen, mouse and keyboard.

Today started well. I ran my project "XMRemoteMonitor" which is a wildlife or security camera web app.
https://github.com/manukautech/XMRemoteMonitor
The functionality is all in the web app so no installation needed. I only needed to visit my  website with the built in "Chromium" browser. This does need to access the device camera. I had an expensive Pi special camera plugged in but the Web App could not find that. Then I plugged in an old general purpose Microsoft webcam from one of my boxes of old leftover tech and that worked including automatic plug-and-play recognition. All good so far, acting like any other device. The Rasbian desktop even gives me a Windows-like experience.

But then the Pi only took 27 webcam photos over about 5 min before completely freezing up. The screen was still visible and connecting via VNC but all controls were frozen. During that 5min I did get readings of 0.29 and 0.30 Amp for the current drain. This is similar to smartphone current draw when they run the same app. As a mostly Windows practitioner I have Linux friends teasing me about Windows freezing. Well! It appears Linux can do that too!

This gives me an idea for my next Pi trial. Install "Windows 10 IOT" which is a lightweight Windows 10 for small devices like the Raspberry Pi. Then run the same web app - will it go better?

Results in the web app:


Setup. The Raspberry Pi Zero is the small green circuit board sitting on a white powerbank.
Pi has 2 x micro USB ports. The left USB is fully functional and I have plugged the webcam into it with an adapter. The right USB is for power supply only.



Wednesday, February 13, 2019

Journey of the Rocket 03 - Water and Electronics do mix!

Link to full article on Facebook:
https://www.facebook.com/groups/nzrocketry/permalink/10161300046625696/

I am getting more and more interested in doing interesting things with low power rockets. It is education and robotics that led me to a rocket interest. My rocket-for-education design that started with a rocket motor of "E" power rating is now reducing and I am now designing for "B" power. The aims being:

  • to be able to launch from school grounds 
  • to take sensor readings
  • to do all-electric recovery.

I think even small rockets need to detect apogee with an altimeter to control recovery and the electronics involved are now small enough and low cost enough to work as part of a student project. The video shows - shock! horror! - a water rocket for prototype testing of an altimeter circuit. That does achieve proof of concept although I am having challenges with lightweight battery versus relatively power-hungry bluetooth module.

Journey of the Rocket 02 - Catapault(?!)

Link to article and video on Facebook:
https://www.facebook.com/groups/nzrocketry/permalink/10161245144325696/

Trying out some rocket design ideas eg air brakes by launching a test body with a catapault to get a close-up look at apogee behaviour. The air brakes do not deploy but I get some other good learning value. The tail fins seem to be remarkably effective at low speeds as in too effective. They are pointing the body nose down very soon after apogee which keeps the air flow going past the body from nose to rear which keeps the air brakes closed. I was hoping for some random airflow to catch the air brakes and help them open.

Tuesday, February 12, 2019

Journey of the Rocket 01

Rockets! These have been one small activity in the "HiTechFromLoTech" project, the idea being to use our by now sweet combo of smartphone-bluetooth-arduino as rocket and model aircraft flight recorders possibly leading to flight control. 2 students picked this up as their project at the end of 2018 and they have done excellent work with it, to the point that "Rockets" may take over as the flagship or number one activity here.






Sun 11 Nov launch day with NZ Rocketry at their launch field on a farm was excellent value for my students and me. Thanks to everyone for making us welcome. Special thanks to Alex for his help and advice and for flying our smart-phone-as-flight-recorder experiment, Thanks also to Jim Hefkey and Tristan O'Hanlon of APSS for their help and encouragement. Some findings: The lowest cost smart phone, Vodafone VFD-300, ($39 on special) did take video and record data. Data recording rate was about 15 samples per second. Our altimeter graph is close to Alex's TeleMega result. GPS results are approximate and the GPS biggest achievement is to place us on the farm. The most accurate GPS result is for walking down the track with the recovered rocket. The smart phone is working well after its flight experience. Jasmin gets a programming hero award. The day before she upgraded the user interface and data recording stopped working. On Sunday, Clinton drove while Jasmin did extreme phone programming. She got data recording up and running again minutes before the launch. Graphs are by our data analysis student Li who has been digging up her high school physics knowledge to analyse this. Our next experiment will be to try using GSM 3G cellphone data networking to send data to Earth while the rocket is in flight.

Alex loading our student instrument package into his rocket

Student instrument package in place



Data collection - smartphone records data into its SQL-Lite database


Data Analysis done post-flight - "Journey of the Rocket" 





Tuesday, December 11, 2018

XMRemoteRobot - SignalR - nice messaging but watch out for the size limit

Early successes with SignalR for Internet communications got us thinking, "let's use SignalR for everything!". Sending images from the robot camera being first on our TODO list. As in see through the robot's eyes. We attempted sending images as "base64" strings. We can share with you that SignalR does not handle big strings in one message. When we tried this we had no error messages and apparently almost-working results like the first image received as a small black image. That looked promising enough to keep trying until we thought of  testing with smaller message sizes and our broken communications started working.

Time for a Google search. "signalr maximum text length" which found
"There's no maximum message size but we recommend < 32K per message" on the Github home site. ref: https://github.com/SignalR/SignalR/issues/1205

That got us trialling different sizes of messages on XMRemoteRobot with the finding that our maximum reliable message string length is 32700 characters.

We process the still images from our robots into 'base64' encoded strings of about 640K in length so that is not going to work as a single chunk. Next steps in this development:



A possible alternative. "Ricardo" writes about achieving video streaming without audio over SignalR:
https://weblogs.asp.net/ricardoperes/video-streaming-with-asp-net-signalr-and-html5