Thursday, October 15, 2015
Home Data Collection
I’ve been thinking about the data collection I do. Specifically about what machines are doing the collection and what type of system load and stability my current system has.
Today, I have two primary data collection functions running.
1) Home electricity production/usage data.
2) Outside weather data.
For the electricity data I have a daemon running on my main machine that pulls the raw data from a monitor attached to the mains. The raw data is processed and stored in a MySQL database. The monitor is attached to the machine via a USB port.
For the weather data I have a program running on a Raspberry PI that intercepts raw data from an Acurite 5-n-1 sensor bridge, processes it and stores it in a MySQL database.
The MySQL database resides on a dedicated disk partition and the server is running on my main machine. The database is also used for a few other things like a bug tracking database. The clients of the database are my web server (also running on the main machine) and the home automation software package (currently running in a vmware Windows instance on the main machine).
What if this was all consolidated on to a dedicated home data collection server? That’s the question I’m asking myself right now. That leads to a few more questions.
- What exactly should be consolidated? Data collection daemons, MySQL database, webserver?
- Can a Raspberry PI handle all of this?
- Would it improve stability?
- What hardware is needed in addition to the Raspberry PI?
- Can an SSD drive be used with the database?
- How easy will be to back this all up?
After a bit more thought and some research, I think I have answers for most of the questions. All three major components should be consolidated. Given how much interaction there is between the data collection daemons and the database it just makes sense to have them on the same machine if possible. Same for the web server and database. The disk space needed to support both database and web server is not excessive and easily handled by a low cost SSD. Currently it’s less than 50GB and it’s not growing that fast. A 120GB drive should suffice for a number of years. The Raspberry PI should handle the data collection daemons easily. It should also be able to handle the database. The web server handles mostly private needs so I think that’s fine, but will need to do some testing to be sure.
For hardware I think just the Raspberry PI with OS on an SD card. Probably a USB hub to handle the addition network interface, electricity monitor and SSD disk. And of course the SSD disk 120GB or 240GB.
The SSD drive can be shared via NFS and/or SMB and that provides both a way to back it up and add web content easily.
So time to start prototyping. I have an extra PI and spare hard drives so I should be able to install most of the software and make sure the services are running. Then it’s just a matter of switching over.
Now what other data could I collect using this setup?
- Posted by Bob at 12:55:27 in Automation
- 66 comments (10674 views)
-
Add comment
Fill out the form below to add your own comments
Monday, May 7, 2018 - 21:52:49
The most conclusive and unanswerable way for data collection. Different people having different house hold qualities and with a lots of new things that is necessary to collect and share with the others.
Sunday, February 3, 2019 - 10:57:21
All of the above collection is good but believe me, there must be some other suitable options by which the collection may be made more interesting.
Sunday, February 2, 2020 - 23:12:50
Primary data collection methods are useful at home, in schools, and work environments. Thank you for sharing this useful article.
Monday, February 10, 2020 - 23:08:21
Writing research papers is unavoidable especially for those who are in universities. It is therefore good to learn how to do it earlier to avoid writing poor-quality research papers.
Tuesday, April 14, 2020 - 00:43:38
Gotoassignmenthelp Services comparatively low prices.GotoAssignmenthelp Service is a well-established and prominent name in providing high-quality Assignment Helponline to students since almost a decade. You can trust our academic ghostwriters completely to get best quality write-ups including case studies,
Tuesday, July 21, 2020 - 22:58:14
Your thoughts may be in order but when it comes to translating them to words on paper that have a flow and consistency as well as perfect grammar, this is beyond most students.
Monday, August 17, 2020 - 23:50:23
Businesses and people everywhere have the resources and reach to provide a major positive impact in their communities. Whether it’s by supporting education with a monetary donation, mentoring or volunteering, participating in acts of “giving back” has extensive benefits for everyone involved, especially the students who receive the gift of education For More Information Visit.
Friday, November 6, 2020 - 02:45:29
Mcafee Login Account is your one-stop key for accessing and utilising all the benefits and features of the amazing Mcafee security applications. This online platform allows you to purchase and manage your subscriptions with utmost ease. Besides, it allows you to manage your account and billing information.
Friday, November 6, 2020 - 02:46:11
Webroot offers globally acclaimed, cutting-edge cybersecurity solutions that guarantee unbeatable protection for all your connected devices. Its innovative and user-friendly products are regarded as some of the most robust and versatile options.
Friday, November 6, 2020 - 02:46:58
AOL is a reputed Email service provider known for its state-of-the-art and fully secure communication solutions.
However, it is not just limited to the web-based messaging service. In fact, it provides a whole lot of products and services to enhance and safeguard your digital life.
Friday, November 6, 2020 - 02:48:19
Microsoft Office or simply Office (office.com/setup) is an exceptionally effective and efficient suite of Software Applications. This Software Suite offers a well-integrated fleet of various Productivity Tools. These cutting-edge tools are designed specifically for automating the time-consuming, labour-intensive manual office work. It extends a wide range of purpose-specific tools like Word,OneNote, Excell, Outlook, Powerpoint, etc.
Friday, November 6, 2020 - 02:48:56
Roadrunner Email, also known as Spectrum email, is a no-cost email service that has gained immense popularity in recent years. In past years, Time Warner Cable, an internet service provider, has offered this service to millions of users around the globe. But later, Spectrum of Charter Communication has overtaken the service.
Friday, November 6, 2020 - 02:49:47
SBCGlobal Login is an eminent emailing server provider in America. This service came up from the merger of Yahoo and ATT but now it is fully owned, controlled, and run by ATT itself. This emailing platform holds a prominent place in the user’s personal as well as professional life since the time it came into existence. Now, this email service has discontinued.
Friday, November 6, 2020 - 02:50:27
The world keeps on changing fast and so do the roads. Every single day, a new road, bridge, or underpass gets built. This generates the need of knowing the exact route so as to enjoy a smooth and hassle-free driving experience. Considering this, Navman provides profound GPS devices that are built with splendid technology and features.
Friday, January 29, 2021 - 00:21:00
https://testbanksonline.com/tbsm/wordsmith-a-guide-to-college-writing-7th-edition-solution-manual
Monday, March 22, 2021 - 03:58:10
Amazon is one of the leading eCommerce platforms used by millions of users all across the world. The major reason behind the massive success of Amazon is its passion for giving quality products at an affordable price range. Amazon provides its users with an extensive range of products under diverse categories.
Monday, March 22, 2021 - 03:58:47
PayPal is a service that people use as a way of sending, receiving, and requesting money online. Moreover, we consider it an all-in-one payment solution for online sellers to access millions of shoppers worldwide.
Monday, March 22, 2021 - 03:59:09
AOL mail provides a great platform to interact with different people. It is a completely safe and secure platform for users to connect with anyone without their data being shared. It is also known as AIM mail. To send mails, the user should have an account on AOL mail. If the user does not have an account on AOL, he/she must create one.
Monday, March 22, 2021 - 03:59:38
Bitdefender login account is the way to manage the Bitdefender products. So, the users having bitdefender products must have their account. Therefore, through the bitdefender login credentials, the user can easily access the bitdefender central account. However, once the user accesses their account, they can easily manage all their bitdefender products remotely.
Monday, March 22, 2021 - 04:00:02
Mywifiext is a simple yet widely used web address that complies with an easy-to-use interface. It facilitates the users with hassle-free Netgear account management. Also, one can set up the extender easily through it. Mywifiext makes it easy for you to manage your Netgear extenders and account with many options that help in the personalization of the setup.
Monday, March 22, 2021 - 04:00:37
There are millions of happy users of Linksys Extenders worldwide. This extender boosts up the user’s experience by increasing the internet speed and network. Moreover, it facilitates extending the wireless router range even in the dead signal or low network zones.
Monday, March 22, 2021 - 04:01:32
TomTom comes under one of the best companies which provide a wide range of GPS devices. TomTom Home is a tool for the TomTom GPS navigation systems. It allows its users to manage their actions on this device. It also has many useful features, such as restoring and backing up the user’s TomTom device and quickly installing new maps and services.
Monday, March 22, 2021 - 04:02:02
Avast antivirus is one of the leading antiviruses with millions of users worldwide. It provides the best security for your devices against malware and cyber threats. Also, the advanced features of Avast easily detect all the possibilities of viruses and spying eyes to your network. As a result, the users are safe with their networks and also have a great network speed.
Wednesday, March 24, 2021 - 02:56:29
Essay presents a logical and reasoned point of view in response to particular question or statement. An effective analytical essay structure helps your ideas to unfold noticeably to the reader. So if you want your essay formats structured with perfection, then hire our qualified writers
Sunday, May 16, 2021 - 23:23:07
Excellent Dish Service provides Satellite Dish TV Installation & Recharge Repair in Sharjah at an affordable price. We have the best staff for any kinds of satellite repair, installation, and maintenance as well as any kinds of brands and models.
Wednesday, May 19, 2021 - 00:07:28
Contact us on our customer service helpline number, and our knowledgeable technicians can assistance you.
Wednesday, May 19, 2021 - 00:08:12
Contact us on our customer service helpline number, and our knowledgeable technicians can assistance you.
Thursday, June 3, 2021 - 03:21:49
Contact us on our customer service helpline number, and our knowledgeable technicians can assistance you. We restore and recognize issues with machines, laptops, networks, smartphones, tablet computers, programs, viruses, etc., you don’t need to break off your devices and take them in a shop or office. Customer support is a service provider 100 percent recognized within the US which helps to fix your PC remotely, professionally and basically
Friday, August 27, 2021 - 14:29:45
Progesterone Secure Ordering Best Website With Free Shipping
Saturday, August 28, 2021 - 03:16:11
http://buystromectolon.com/ - Stromectol
Saturday, August 28, 2021 - 18:30:13
https://buysildenshop.com/ - viagra pricing
Thursday, September 9, 2021 - 23:38:16
https://buypropeciaon.com/ - do you need a prescription for propecia
Tuesday, September 14, 2021 - 19:00:28
Foro Compra Viagra
Wednesday, September 15, 2021 - 12:09:41
http://buypriligyhop.com/ - buy priligy in the us
Thursday, September 16, 2021 - 06:55:00
Cialis 10mg Cost
Friday, September 17, 2021 - 05:01:43
Buy Now Amoxicilina Pills
Friday, September 17, 2021 - 12:09:58
http://buylasixshop.com/ - what is furosemide used for
Friday, September 24, 2021 - 13:31:05
https://buyzithromaxinf.com/ - buy zithromax z pak online
Sunday, October 3, 2021 - 06:36:16
http://buyneurontine.com/ - Neurontine
Sunday, October 10, 2021 - 03:41:13
https://prednisonebuyon.com/ - can i buy prednisone in mexico
Tuesday, October 26, 2021 - 04:17:15
Here you can avail all the details and product review sites in India for kitchen appliances . https://checkreview.in
Friday, October 29, 2021 - 15:44:18
Buying Cytotec Online
Friday, October 29, 2021 - 21:08:21
Vente Viagra Lyon
Tuesday, November 2, 2021 - 16:31:37
Viagra Online Us Pharmacy
Thursday, November 11, 2021 - 05:34:48
Viagra Kaufen Auf Rechnung Ohne Rezept
Thursday, November 25, 2021 - 23:20:22
Solutions manual and Test Banks Online are the easiest tools to increase your college grades instantly. Get a 4.0 on your exams with Corporate Finance Global Second Edition Test Bank today.
https://testbanks21.com/tbsm/corporate-finance-global-second-edition-test-bank/
Thursday, December 2, 2021 - 00:50:19
https://testbank2022.com/p/test-bank-for-primary-care-a-collaborative-practice-5th-edition/
Monday, December 6, 2021 - 02:00:45
Levitra Stuffy Nose
Wednesday, December 8, 2021 - 04:48:09
Looking for Survey Of Economics Principles Applications And Tools 5th Edition Solution Manual ? Your search has come to an end at TestBanks21, the best learning solution online.
Sunday, January 23, 2022 - 00:48:06
http://alevitrasp.com FrorNite cialis segunda mano
Wednesday, April 13, 2022 - 03:02:09
https://scholaron.com/subjects/statistics/
Friday, April 29, 2022 - 05:07:06
Also, once the packaging specifications are shared, the customer representative https://customboxesbulk.com/t-boxes/ t packaging will call with the quote. Once you give a final call, you will be sent the invoice, so pay that and go along with the order.
Tuesday, May 3, 2022 - 22:58:13
https://testbanks22.com/p/essentials-of-psychiatric-mental-health-nursing-concepts-of-care-in-evidence-based-practice-6th-edition-test-bank/
Thursday, June 16, 2022 - 22:53:47
ivermectin from canada http://www.ivermectinoge.com/
Thursday, June 23, 2022 - 20:05:58
https://stromectolusdt.com/ stromectol price us
Saturday, June 25, 2022 - 22:52:08
http://ivermectinetc.com/ buy stromectol online
Wednesday, June 29, 2022 - 08:42:57
https://www.ivermectinoge.com/ cheap ivermectin
Monday, December 26, 2022 - 01:24:02
http://www.hydroxychloroquinex.com/ plaquenil hydroxychloroquine
Friday, February 10, 2023 - 20:18:06
I have been looking for articles on these topics for a long time. I don’t know how grateful you are for posting on this topic. Thank you for the numerous articles on this site, I will subscribe to those links in my bookmarks and visit them often. Have a nice day
http://images.google.com.au/url?sa=t&url=https%3A%2F%2Ftotosafe.com
Friday, February 23, 2024 - 07:05:53
http://instasecrettips.com/instagrams-video-selfie-verification/?unapproved=507195&moderation-hash=f7fc1c0f710c7cb39170f1a7d60b7f7a#comment-507195
http://fundacjadroga.org/kontakt/#comment-17718
http://hvaroba.com/?page_id=2397&cpage=1&unapproved=141203&moderation-hash=e79751c7ccf6a05da00b9231a116e122#comment-141203
http://hcrey.net/index.php/2019/03/04/hello-world/?unapproved=626014&moderation-hash=b8bba7229fa88c3fc6143e8d68134ae5#comment-626014
http://glazzette.com/uncategorized/hello-world/?unapproved=346591&moderation-hash=89cbca93db4d148a108e39307f298da7#comment-346591
Sunday, February 25, 2024 - 08:19:16
http://rosttour.com/index.php?subaction=userinfo&user=etuhyzy
http://rtbu.ru/index.php?subaction=userinfo&user=ugocyg
http://ru-adres.ru/index.php?subaction=userinfo&user=onutifo
http://ru.monumentefunerare.md/index.php?subaction=userinfo&user=imexo
http://regata.yar.ru/component/kunena/%D1%80%D0%B0%D0%B7%D0%B4%D0%B5%D0%BB-%D0%BF%D1%80%D0%B5%D0%B4%D0%BB%D0%BE%D0%B6%D0%B5%D0%BD%D0%B8%D0%B9/3120-%D0%B3%D0%B4%D0%B5-%D0%B2%D0%BE%D0%B7%D0%BC%D0%BE%D0%B6%D0%BD%D0%BE-%D0%B7%D0%B0%D0%BA%D0%B0%D0%B7%D0%B0%D1%82%D1%8C-%D0%B4%D0%B8%D0%BF%D0%BB%D0%BE%D0%BC-%D0%BE%D0%B1-%D0%BE%D0%B1%D1%80%D0%B0%D0%B7%D0%BE%D0%B2%D0%B0%D0%BD%D0%B8%D0%B8#8146
Friday, April 19, 2024 - 15:34:09
http://smpn3mranggen.sch.id/forum/
https://www.buehnehollenthon.at/guestbook2/
http://gamenglish.com/message/index.php?l=
http://beachhouse-living.com/index.php/component/kunena/user/21618-oteqyhume
http://www.asanagikai.com/blog/1167.html?unapproved=1955025&moderation-hash=13a69e619e49029a1b646269d90caa3d#comment-1955025
Купить аттестат классов – ключ для твоему перспективам. На данном портале все вы сможете легко и быстро купить аттестат, нужный для того, чтобы дальнейшего обучения или трудоустройства. Наши эксперты обеспечивают высокое качество и секретность предоставления услуг. Приобретайте учебный аттестат здесь и откройте другие варианты для того, чтобы вашего образования и карьеры.
Saturday, April 20, 2024 - 12:47:42
https://www.baby-country.ru/forum/topic.php?forum=20&topic=48033
http://www.diablomania.ru/forum/showthread.php?p=560057#post560057
Купить аттестат за 11 класс – возможность к вашему перспективам. В данном портале вы сможете легко и оперативно заказать свидетельство, нужный для дальнейшего обучения или профессионального роста. Наша консультанты обеспечивают качество и секретность услуги. Заказывайте учебный аттестат здесь и проявите новые варианты для своего профессионального роста и карьеры.
Wednesday, April 24, 2024 - 08:17:21
http://old.wigfashion.ru/product/999-pure-remuvolosy-na-klipsah22/reviews/
http://helenos.pavel-rimsky.cz/doku.php?id=premialniediplomany
https://vitaco.ru/communication/forum/user/4027/
http://www.newrancho.ru/2014/01/blog-post.html
http://www.octaniumsw.site/2018/01/ssd-m2-acer-nitro-5-an515-41-f9wl.html
Купить школьный аттестат – это существенный фактор вашего будущего. Воспользуйтесь нашим сервисом, чтобы просто и без труда приобрести документ, необходимый для последующего образования или трудоустройства. Наши высококвалифицированные специалисты предоставляют качество и защищенность предоставляемых услуги. Покупайте школьный аттестат у нас и открывайте дополнительные возможности для своего образования и карьеры.
Wednesday, April 24, 2024 - 23:12:48
https://alternatio.org/index.php?option=com_k2&view=itemlist&task=user&id=158500
http://gundeminfo.az/index.php?subaction=userinfo&user=ofalov
http://sport-engine.com/menuv-rule/le-mans/item/29-24-iskluchitelnih-chasa-subbota.html
http://stavklad.ru/viewtopic.php?f=24&t=4832
https://njt.ru/forum/user/171203/
Сколько купить аттестат – это важный инструмент твоего перспектив. Воспользуйтесь нашими сервисом, чтобы просто и без труда приобрести документ, необходимый для продолжения учебы или трудоустройства. Наши высококвалифицированные специалисты обеспечивают высокое качество и конфиденциальность предоставляемых услуг. Покупайте школьный аттестат у нас и обнаруживайте дополнительные перспективы для личного образования и трудоустройства.
Thursday, April 25, 2024 - 15:11:49
http://istinastroitelstva.xyz/index.php?subaction=userinfo&user=amicehug
http://e-audit.gefest.me/index.php?subaction=userinfo&user=upybax
http://44klada.ru/viewtopic.php?f=6&t=4018
http://eco-adamant.kz/index.php?subaction=userinfo&user=ubahujyge
http://www.ifreemax.ru/2015/06/forum-madrid-startup-weekend-2015.html
Можно ли купить аттестат – это ключевой фактор вашего будущего. Воспользуйтесь нашем сервисом, чтобы просто и без труда приобрести документ, необходимый для продолжения учебы или карьерного роста. Наши опытные специалисты гарантируют высокое качество и конфиденциальность предоставляемых сервисов. Покупайте школьный аттестат у нас и обнаруживайте новые варианты для личного образования и карьеры.