Ad

Showing posts with label ESP8266. Show all posts
Showing posts with label ESP8266. Show all posts

Sunday, August 11, 2024

Making everything a connected device

Abstract

Today we are definitively getting to a point where it becomes challenging to draw the line between a household product being bought and built to serve its consumer, and that same product being designed and equipped for serving other entities beyond the knowledge of its official owner.

Many forms of technological progress converged to get us to a point where it becomes ambiguous and unclear what is the full scope of the sophisticated technological products that are all around us and so often extremely affordable, in spite of its immense capabilities. One of the most obvious examples is of course the smartphone. Its computing power often overlaps that of a personal computer, while still fitting in a pocket and having a plethora of sensors and hardware features, some of which the user may never know these are present and for what purpose these serve.

At home, is more and more the normal scenario to have the most prosaic devices, such as light bulbs and switches, all equipped with a chip that renders these connected to the Internet. Once this is done, all bets are off. For the consumer is very convenient, because at the reach of an app, one can control and monitor his property or perform tasks remotely.

Today is a bit of a gamble. Between the comfort and convenience provided by technology in the realm of the home environment, there is also the security risk, privacy and the user being manipulated and targeted by manufacturer campaigns, or its information sold to third parties for similar purposes.

Still, however powerful and discrete these technologies might be, the greatest joy lies in leveraging its power for the own use, and that is, with no strings attached, and the user really running the show.

That is where I like to sit at. It is true that for IoT tech to become so abundant, cheap, and with routes for open use, the fact is that intentionally or not, manufacturers (regardless of their agendas) gave way for the communities to build on their hardware, but ultimately not being dependent of their clouds and platforms. Projects like Tasmota or ESPHome are one such example, where off-the-shelf products like bulbs and switches are often modified/reflashed to run one of these firmwares.

Concept

Here I am presenting a bit of a different approach though. Starting with a very conventional insect zapper with nothing that can be pinged from the Internet (no electronics whatsoever -  a couple of light bulbs, a ballast, two starter switches, and a Cockcroft–Walton multiplier for generating the HV to zap the insects), I wanted to integrate it better in home automation without requiring external devices such as Wifi sockets or such. 

Implementation

And so I went. The first iteration was to put an ESP32 relay board on it. I used the "ESP32_Relay X1" board which I had used in previous projects with good results. This board has the advantage of having an integrated 230 V insulated SMPS, making it very convenient for integrating in mains powered devices:

It was a relatively uneventful assembly. Drilled some holes in the case and attached the board with the help of some standoffs.


Worked just as it was supposed to. Installed Tasmota32-nspanel (yes, this variant, because with the regular build, the relay GPIO will temporarily go high on boot-up because by default the firmware uses this pin and a few other pins for communication with the PSRAM chips - a poor routing choice from the board manufacturer).

But then for me it felt boring to just be able to turn the zapper on and off. What about if I could also detect and count the number of times the zapper would kill insects? That could be fun.

And so I decided to go to the 2nd stage. The ESP32, as some of you might know, has plenty of GPIO ports, and is overall a much more eclectic chip than its predecessor, the ESP8266. One can connect digital signal inputs, as well as DC analog signals to some of these pins, and use the data and events for their projects.

My challenge was to be able to sense the insect getting zapped. My first assumption was that when an insect gets zapped, there is a burst of current flowing across the HV power supply of the zapper. But measuring this HV current could be tricky do to safely and without a lot of precautions. Also I did not want to spend too much time with this project and to risk hardware and especially my health with iterations. So I went for an option that seemed a bit safer and that could also provide results. The idea was to measure the mains AC current on the input side of the HV power supply. 

Unsurprisingly in most products of this kind, this device uses a Cockcroft–Walton multiplier for generating the HV. There is basically a set of diodes and capacitors (9 capacitors and 9 diodes to be more exact) where each pair of diodes and capacitors forms a stage. In this case we have 4.5 stages, which means that the output voltage can reach close to  2 * 4.5 times the input voltage Vpp. In this case it means approximately 2070 Volts.


This curcuit also has three resistors. One or two I presume are for limiting the input current (without it there would be one massive jolt of current for recharging the capacitors), while the other acts as a bleed resistor, to make sure the capacitors are discharged before someone might think of putting the fingers where is not supposed to.

So my idea was to (non-invasively) tap into the phase or neutral lines of this AC input in order to measure the current. My expectation was that during and after a zap there should be a flow of current, therefore making it possible to detect the insect getting zapped. For that effect I grabbed one of these CT boards sold cheaply on Aliexpress:

I did a modification on it however: first these have a capacitor that removes the DC offset from the LM358 opamp output. I didn't want that, because I had to supply a positive signal to the ESP32 ADC input. Secondly, these boards output a voltage that varies with the current signal. In this case the AC signal could be difficult to deal with. So I removed the capacitor, replaced it with a diode, and added a 4.7 uF capacitor in parallel with the output. This way I had a stable signal with no ripple, and more or less proportional to the current. Easier to measure by the ADC.

Connected it to GPIO34, which is the pin behind ADC1 of the ESP32, one of the pins that can be used by Tasmota:


At first, after this modification, I noticed stability issues, i.e. often as I would turn on the zapper, the ESP32 would restart. Because before this modification this behaviour didn't occur, I suspected that it could be related to noise being induced to the 3.3 Volt line due to the mains being rapidly switched. As I was powering the CT board from that rail, and as the wires had to cover some distance, I suspected this could be the cause. That is a particularly sensitive rail, as it also powers the ESP32 microcontroller.

In order to fix it, I added a ferrite bead to the 3.3 Volt rail, and twisted the wires going to the CT board around each other. And, yes instability was gone.

Once the hardware work was completed, it was time to play with the software! My first idea was to use Tasmota rules to detect when the ADC input would measure a value above a certain threshold. I tried this approach but it proved unsuccessful, as the short current pulses would rarely get detected. It is not clear from any of  the project documentation, but apparently rules have evaluation periods that are too long for this scenario.

Without that option, the next best thing I could think of, was to define a driver in Berry (yes, with ESP32, Tasmota opens a whole new dimension of flexibility, by providing a scripting language in the firmware itself, that among many other things, allows the user to code drivers for devices not supported natively by Tasmota), and use its every_50ms callback to put the pulse detection cycle inside.

As such, in a driver we can define code that will get called every 50 ms (that is the maximum you can go). Taking advantage of that, I wrote a small driver that would read the ADC1 pin, and check if the value would be above a certain threshold or not. The threshold I have empirically verified as being a probable discharge and less likely to be noise related. Everytime the threshold is crossed, the driver will publish a message to a specific MQTT topic.

import mqtt
import json
import string

event_threshold = 2110

class ZapperController

def every_50ms()
var sensors = json.load(tasmota.read_sensors())
var zapper_current = sensors['ANALOG']['A1']

# Update the sensor state:
if zapper_current > event_threshold
mqtt.publish("tele/ovalesublime-insect-zapper/EVENT", "{\"event_type\": \"zap\", \"detection\":" + str(zapper_current) + "}")
end
end
end

zapper_controller = ZapperController()

tasmota.add_driver(zapper_controller)

To have a consumer for that event, I configured Home Assistant to subscribe and handle it as a MQTT event:

mqtt:
event:
- name: insect_zapped
state_topic: 'tele/ovalesublime-insect-zapper/EVENT'
event_types:
- "zap"
availability_topic: "tele/ovalesublime-insect-zapper/LWT"
payload_available: 'Online'
payload_not_available: 'Offline'
qos: 1

Testing

For testing (because you don't have flies around when you need them), I picked up a plastic stick, attached a strip of paper to it, and wet the tip. Then by approaching that paper tip from the electrode bars I was able to provoke a discharge the same way an insect would.


And sure enough I was able to produce events:

Conclusions

If you ask if this solution for detecting events is ideal, I would probably say no. First, relying on the 50 ms polling of the Berry driver is not 100% reliable, especially because we are dealing with short lived events. Second, we are capturing a relatively small current that is difficult to discriminate with a current transformer (CT) that is rated for 5 Amps. It is sufficient, but not a strong unambiguous signal. Third, for events we should resort to whatever provisions exist in the microcontroller and the firmware to handle these events as interrupts. This ensures that the processing is fully asynchronous and no events are missed (the processing will forcefully be triggered as a pin state change is detected). My challenge with applying this  approach is that I didn't have enough time to add the hardware for conditioning the signal coming out of the CT, in order to produce a high signal in case of being above the threshold, and a low signal (0V) if below. This could have been implemented by adding a comparator and an adjustment pot. Unfortunately the ESP32 doesn't seem to have a comparator module internally, which would have been very useful for this application.








Monday, December 7, 2020

Turning a doorbell switch into a home security camera...and still retain its original function


Today there is an off-the-shelf solution for practically every average-Joe-grade idea one may have. There is always the chance that when one thinks of something that could have a practical purpose and cover a specific need, that there is already a product in the market that will do that function.
Even though home automation may still be in its infancy, today we see a market practically flooded of solutions that one way or another aim to respond in terms of comfort, or to help improve the home experience, or even to enhance the safety and security of its occupants.

Sunday, December 29, 2019

Ghost switching can be a bitch if your switch is your main circuit breaker






On my way to eat my own dog food, I learned the hard way that ghost switching is kind of the default problem most people will stumble upon when setting up their MQTT switch for the first time.This is not a big deal when you are configuring a single light switch or some other not so critical appliance. But when your switch is in series with your main circuit breaker, ghost switching suddenly gains a whole different level of importance.

Sunday, December 22, 2019

ZMAi-90 (or SMTONOFF WDS688) DIN rail meter/switch - more details on GPIOs and configuration

As an update to the previous post where I have shared the details on how to "Tasmotize" this device, I am adding more detail on what is the physical assignement of GPIO pins from the ESP8266, to other components in this device.

Given the pins from the ESP8266 microcontroller that are exposed in its breakout board (which in turn is SMD soldered to the main PCB):

Friday, November 22, 2019

Attempting to reverse engineer a home automation oriented smart-meter - Part 1

In my quest to make my house smarter, but still looking forward to keep having control over it, I have been doing some additions which I plan to further document here, in the short term.

In the meantime I thought it would be more relevant to share my findings in regard to a device a bit more "exhotic" than the Sonoff boxes we are all used to. This device is a sort of a miniature smartmeter that fits in a DIN rail next to the circuit breakers.



Just like the Sonoff modules, it also pairs with your WLAN, and connects to a cloud service. Instead of the eWeLink cloud to which Sonoff devices connect to, in this case it connects to another relatively popular cloud service called Tuya.