Thursday, November 26, 2020

Simulate Availability Zone failures on AWS

Deploying business-critical systems to Amazon Web Services (AWS), be prepared for anything, including an outage. The design needs to be at least highly available and, at the most, fault-tolerant. If the application or system goes down, there is the possibility of minimal interruption. In the context of AWS, regions and availability zones are used to build both highly available and fault-tolerant systems. But how do you plan if the unthinkable happens? (also on https://techgeezer.io)  

https://dzone.com/articles/chaos-engineering-simulate-az-failures-on-aws 

 #chaosengineering #chaosgroup #infrastructure #datacenter #amazon #aws #techgeezerio

Chaos Engineering

"Chaos Engineering is the discipline of experimenting on a distributed system in order to build confidence in the system’s capability to withstand turbulent conditions in production." -Chaos Monkey(gremlin.com)

https://www.gremlin.com/chaos-monkey/ 

 #chaosengineering #chaosgroup #embracethejourney #engineers #informationtechnology

Tesla Model,X hacked!

 https://www.embedded.com/tesla-model-x-hacked-with-195-raspberry-pi-based-board/?fbclid=IwAR0qIEPHTpGEm6_TzMPvrkY0BF63uQWmr71D90mYCxh-jbXIz4QRUg3C1EY

Friday, November 20, 2020

File database for Rapid Prototype

Using a JSON file DB is an exceptionally useful way to prototype but also is very expeditious. Have some way to rapidly deploy the data that arrives in its native format and even converting it to JSON is quite simple. IF you don't have a MongoDB instance handy, this is a spectacular solution. 

https://www.sitepoint.com/database-json-file 

#json #database #filedb #golang #mongodb #api #python3 #python #programming #datascience #techgeezerio

Wednesday, November 18, 2020

Adapting on the Fly to Test Time Distribution Shift

This is a REALLY good article on M/L for handwriting transcription. We did a similar technique for this but more along the track of image processing with Markov Chain/LSTM.

https://bairblog.github.io/2020/11/05/arm/ 

#ai #mlearning #mlengineer #techgeezerio

Clustering Algorithms

Clustering is a technique that most Data Scientists will use, especially in their journey toward Machine Learning (ML). When given a set of data points, clustering involves grouping them to use a selected algorithm to classify the data into a specific group. Theoretically, data points that share a "grouping" should have similar properties and features, while data points in a "different" group should have highly "dissimilar" properties or characteristics. If we consider cluster, it is an unsupervised learning method and a typical statistical data analysis technique used in numerous domains. Data Scientists can use clustering analysis to gain valuable insights from the data by understanding the groups that data points collect into when applying a clustering algorithm. 

Read the rest here.....


Test

Monday, November 16, 2020

Using vCenter Server with a Raspberry Pi 

I've always liked Raspberry Pi and other SBC devices. This procedure in the link is quite detailed and works. I have it running on a Pi4 device and some Pi Hat Clusters

https://virtualizationreview.com/Articles/2020/10/30/vcenter-server-pi.aspx?oly_enc_id=

 Some Cool Tricks with GitHub

If you have ever wanted to add a Verified Label to GitHub, here are some good articles on how to do this.  Having a good portfolio is essential and using some of these advanced methods, is an excellent practice.

Link 1: https://dev.to/juanfrank77/git-yourself-some-cool-new-tricks-3ah6

Link 2: https://docs.github.com/en/free-pro-team@latest/github/authenticating-to-github/generating-a-new-gpg-key


Sunday, November 15, 2020

Markov Chain Monte Carlo Method

 If you haven’t heard of variational inference or markov chain monte carlo methods (MCMC) then don’t worry, you’re in the majority. These methods are pretty advanced and you only really need to use them for a very specific set of problems and even then, these can be quite daunting to use and approach.

MCMC methods were developed initially to solve problems involving complex integrals for example in Bayesian statistics, computational physics, computational biology and computational linguistics. #datascience #machinelearning #deeplearning #artificialintelligence #statistics #algorithms #sampling


https://machinelearningmastery.com/markov-chain-monte-carlo-for-probability/

Saturday, November 14, 2020

 

Unofficial ACI Guide

Be sure to visit here!  If you are a network centric person and want some detailed technical information about Cisco ACI, this is the place to go!

https://unofficialaciguide.com/

5 CLI Tools That Will Increase Your Velocity and Code Quality


 CLIs can be very useful especially when output is available in debugging and logging modes. There are a few compatibility issues with cross-platform usage but overall, a great tool to leverage.

 Why I don’t use Anaconda R

I’m a big user of R and have often seen compatibility problems with some of the R Anaconda libraries. I have experience with using the Anaconda R and RStudio distribution, and can offer some reports of at least four serious problem with anaconda-installed RStudio IDE that have cropped up. It’s partially clear to me what the source of this problem is, but it seemed to resolve when I re-installed directly from RStudio-provided downloads and C-RAN libraries  

This article goes into some other problems but does align with some of my experience. 

Are SSL Certificates being used by Phishers?


Verifying the SSL connection has taken a drastic turn. See the below link on how this has implications of a phishing attack.

https://www.linkedin.com/feed/update/urn:li:activity:6733480287742779392/


Visual Studio Adds Debugger

Python in Visual Studio Code Update Adds Debugger, Debugpy 1.0

https://visualstudiomagazine.com/articles/2020/10/28/debugpy-vs-code.aspx?oly_enc_id=7099D2481278J0B

Who’s in charge here?

Well, it all started a long time ago....back on Earth, 200 years ago.

I’ll leave it at that.

I’ve traveled our globe 5 times over, seen and done some awesome things as well as some horrific ones but came out on top of it all.

I’m a father to a 17 year old son who “was” a wondrously talented musician.  He will forever live in my heart and each day I shed tears for him.

Enjoy the blog and more to come!

Training with Microsoft DeepSpeed

 I just started using this, and the review is not ready yet since I just started testing (training first, but you get the picture). The i...