Modules
1. What is a Neuron?
2. Neural Networks
3. How Training Works
4. Word Embeddings
5. Attention Mechanism
6. The Transformer
7. How LLMs Work
8. RAG Pipelines
9. Building AI Agents
10. Prompt Engineering
11. Linear Regression
12. Logistic Regression
13. Decision Trees
14. Random Forest
15. K-Means Clustering
16. Cosine Similarity
17. Types of AI & AI Agents
18. Tokenization in NLP
19. Fine-Tuning LLMs
20. Evaluating LLMs
21. Vector Databases Explained
22. Diffusion Models & Image Generation
23. Generative Adversarial Networks (GANs)
24. Reinforcement Learning Basics
25. RLHF: Reinforcement Learning from Human Feedback
26. Convolutional Neural Networks (CNNs)
27. RNNs and LSTMs
28. Overfitting & Regularization
29. Hyperparameter Tuning
30. Support Vector Machines (SVM)
31. Naive Bayes Classifier
32. PCA & Dimensionality Reduction
33. Model Context Protocol (MCP)
34. Why LLMs Hallucinate
35. Context Windows & Long Context
36. Multimodal AI (Vision + Language)
37. AI Ethics & Bias in Machine Learning
38. Classifier Evaluation Metrics: Precision, Recall, ROC & F1
39. Bayesian Inference & MAP Estimation
40. Backpropagation Explained
41. Autoencoders & Variational Autoencoders
42. NLP Text Representation: N-grams, Bag-of-Words & TF-IDF
43. Markov Decision Processes & the Bellman Equation
44. Data Preprocessing & Cleaning for Machine Learning
45. Feature Engineering for Machine Learning
46. ML Frameworks Compared: TensorFlow, PyTorch & JAX
47. Data Selection & Active Learning
48. ML Hardware Acceleration: GPUs, TPUs & Accelerators
49. ML Benchmarking Methodology
50. Responsible AI Engineering: Safety & Robustness
51. DBSCAN & Hierarchical Clustering
52. ML Pipelines: Chaining Preprocessing and Models
53. History & Evolution of AI Systems
54. ML System Design Fundamentals
55. The Machine Learning Workflow & Lifecycle
56. Data Engineering for Machine Learning
57. Model Compression: Quantization, Pruning & Distillation
58. Model Serving & Inference Systems
59. MLOps: Monitoring & Maintaining Models in Production
60. The Turing Test & AI Evaluation
61. Heuristics & Search in AI
62. Genetic Algorithms & Evolutionary Computation
63. Knowledge Representation & Semantic Networks
64. Expert Systems
65. AI and Games: How AlphaZero Works
66. AI in Bioinformatics
67. Symbolic vs. Connectionist AI
68. Constraint Satisfaction Problems
69. Fuzzy Logic Systems
70. Multivariate Regression Analysis
71. Non-Linear Least Squares Fitting
72. k-Nearest Neighbors (kNN)
73. Ridge & Lasso Regression
74. Polynomial Regression
75. Boosting Algorithms: AdaBoost, Gradient Boosting & XGBoost
76. Ensemble Modeling: Bagging, Boosting & Stacking Compared
77. Gaussian Mixture Models
78. Linear Discriminant Analysis (LDA)
79. Anomaly Detection in Machine Learning
80. Time Series Forecasting with Machine Learning
81. Survival Analysis for Machine Learning
82. Multicollinearity & Variance Inflation Factor (VIF)
83. Cross-Validation Strategies
84. Statistical Hypothesis Testing for ML Model Comparison
85. Activation Functions Deep Dive: ReLU, ELU, Sigmoid, Softmax & Swish
86. Neural Network Hyperparameters Explained
87. The Multilayer Perceptron (MLP)
88. CNN Building Blocks: Convolution & Pooling Layers
89. Famous CNN Architectures: VGG, ResNet & Beyond
90. GRUs vs LSTMs
91. Transformer-XL & Reformer: Handling Longer Sequences
92. NLU vs NLG: Understanding vs Generating Language
93. The Pre-Transformer Embedding Era: ELMo, ULMFit & BERT
94. Deep Reinforcement Learning (DRL) Overview
95. Policy Gradient Methods
96. Actor-Critic Methods
97. Self-Supervised Learning
98. Transfer Learning
99. Batch Normalization & Layer Normalization
100. ML Deployment Paradigms: Cloud, Edge & Mobile
101. Edge AI & TinyML
102. System Balance: Matching ML Workloads to Hardware
103. Neural Computation Fundamentals
104. Network Architecture Design Tradeoffs
105. Distributed Training: Data & Model Parallelism
106. Federated Learning
107. ML Reproducibility Engineering
108. Feature Stores Explained
109. Model Registry & Versioning
110. A/B Testing ML Models in Production
111. Shadow Deployment & Canary Releases for ML
112. ML Cost Optimization
113. ONNX & Model Interoperability
114. Model Explainability: SHAP & LIME
115. ML System Observability
116. Synthetic Data Generation
117. Data Augmentation Techniques
118. ML Security: Adversarial Attacks
119. Privacy-Preserving Machine Learning
120. Chain-of-Thought Reasoning
121. Mixture of Experts (MoE)
122. Speculative Decoding
123. Constitutional AI & Alignment Techniques
124. Tool-Use Patterns in LLM Agents
125. Advanced RAG Patterns: Hybrid Search & Re-ranking
126. Semantic Search vs Keyword Search
127. Fine-Tuning Embedding Models
128. Prompt Injection Security
129. AI Red-Teaming
130. Speech Recognition (ASR)
131. Text-to-Speech (TTS)
132. Computer Vision: Object Detection
133. Image Segmentation
134. OCR & Document AI
135. NumPy Fundamentals for Machine Learning
136. Pandas for Data Science
137. Data Visualization for ML with Matplotlib
138. Model Interpretability: Feature Importance Methods
139. ML Experiment Tracking
140. AutoML Explained
141. Handling Imbalanced Data: SMOTE & Resampling Techniques
142. Multi-Label Classification
143. Multi-Task Learning
144. Zero-Shot & Few-Shot Learning
145. Curriculum Learning
146. Model Calibration
147. Snapshot & Neural Network Ensembles
148. Knowledge Graphs in AI
149. Jupyter Notebooks for Machine Learning
150. Linear Algebra for Machine Learning
151. Calculus for Machine Learning
152. Probability Theory for Machine Learning
153. Information Theory: Entropy, Cross-Entropy & KL Divergence
154. Optimization Algorithms: SGD, Adam & RMSprop Compared
155. Convex vs. Non-Convex Optimization
156. Lagrange Multipliers & Constrained Optimization
157. Monte Carlo Methods in Machine Learning
158. Numerical Stability in Machine Learning
159. The Central Limit Theorem for Machine Learning
160. Bootstrapping & Resampling Methods
161. Bayesian vs. Frequentist Statistics
162. Confidence Intervals for ML Metrics
163. Power Analysis & Sample Size Calculation
164. A/A Testing & Experiment Validity Checks
165. The Adam Optimizer Explained
166. Learning Rate Schedules: Warmup, Cosine Annealing & Step Decay
167. Gradient Clipping
168. Mixed Precision Training
169. Weight Initialization Strategies
170. Association Rule Mining & the Apriori Algorithm
171. Collaborative Filtering for Recommender Systems
172. Matrix Factorization for Recommender Systems
173. Content-Based Recommender Systems
174. The Cold Start Problem in Recommender Systems
175. Spectral Clustering
176. Mean Shift Clustering
177. Local Outlier Factor (LOF)
178. t-SNE Deep Dive
179. UMAP Deep Dive
180. Graph Neural Networks (GNNs)
181. Siamese Networks
182. One-Shot Learning & Meta-Learning (MAML)
183. Neural Ordinary Differential Equations (Neural ODEs)
184. Normalizing Flows
185. Energy-Based Models
186. Restricted Boltzmann Machines (RBMs)
187. Self-Organizing Maps (SOMs)
188. Capsule Networks
189. Spiking Neural Networks (SNNs)
190. Part-of-Speech Tagging & Named Entity Recognition
191. Dependency Parsing: Representing Sentence Structure
192. Coreference Resolution: Tracking Who's Who in Text
193. Text Summarization: Extractive vs. Abstractive
194. Machine Translation: From Rule-Based to Neural
195. Language Model Perplexity: What It Measures
196. Subword Tokenization Deep Dive: BPE, WordPiece & Unigram
197. Byte-Level Tokenization: Solving the Unknown-Token Problem
198. Instruction Tuning Datasets: Building FLAN & Alpaca-Style Data
199. RLHF Reward Hacking: When Models Game the Reward Model
200. Image Classification Metrics: Top-1 & Top-5 Accuracy
201. Super-Resolution with GANs
202. Neural Style Transfer
203. Human Pose Estimation
204. Face Recognition Systems
205. Video Action Recognition
206. Point Clouds & 3D Vision
207. SLAM Basics (Simultaneous Localization and Mapping)
208. Vision Data Augmentation Deep Dive
209. Image Captioning
210. Multi-Agent Reinforcement Learning
211. Inverse Reinforcement Learning
212. Imitation Learning
213. Reward Shaping in Reinforcement Learning
214. The Sparse Rewards Problem in RL
215. Sim-to-Real Transfer in Robotics
216. Offline Reinforcement Learning
217. Curiosity-Driven Exploration
218. Hierarchical Reinforcement Learning
219. Model-Based Reinforcement Learning
220. The ReAct Agent Pattern
221. Plan-and-Execute Agents
222. Multi-Agent Orchestration Patterns
223. Agent Memory Architectures
224. Agent Evaluation Methodology
225. Prompt Caching & Context Caching
226. Structured Outputs & JSON Mode
227. Vector Database Comparison Deep Dive
228. LoRA Merging & Model Merging
229. Quantization Formats: GGUF, AWQ & GPTQ Compared
230. AI Regulation: The EU AI Act & Risk-Based Frameworks
231. AI & Copyright: Open Questions
232. The Environmental Impact of AI
233. AI and the Future of Work
234. Learning to Rank for Search
235. Fraud Detection Systems with Machine Learning
236. Credit Scoring Models
237. Demand Forecasting with Machine Learning
238. Small Language Models (SLMs) vs. LLMs
239. On-Device LLMs
240. The Hugging Face Ecosystem Overview
241. LangChain vs. LlamaIndex
242. Agent Framework Comparison: AutoGPT, CrewAI & LangGraph
243. Feature Crossing for Recommenders
244. A/B Testing ML-Powered Products
245. Isolation Forest Deep Dive
246. OPTICS Clustering
247. Affinity Propagation Clustering
248. Decision Stumps & Weak Learners
249. Hopfield Networks
Share Guide
AI & MLDeep
Advanced

AI in Bioinformatics

12 min read

Learn
Deep Reading
Estimated 12 mins
Prereq
Advanced
Requires advanced math/coding
Interactive
Static Playbook
Static guide & reference tables

Biology as an information problem

Bioinformatics treats DNA, RNA, and proteins as sequences of symbols — four-letter alphabets for nucleic acids, twenty-letter alphabets for amino acids — and applies computational methods to extract meaning from them. This framing makes biology tractable for AI: comparing two gene sequences becomes a string-matching problem, predicting a protein's shape becomes a structured prediction problem, and finding disease-associated genetic variants becomes a pattern-detection problem over enormous datasets.

The field exploded in importance once sequencing became cheap: the first human genome cost roughly three billion dollars to sequence in 2003, and today a genome can be sequenced for a few hundred dollars. That flood of data is exactly what modern machine learning needs to be useful, and it's why bioinformatics has become one of AI's most consequential application domains.

Sequence alignment: the oldest problem in the field

Sequence alignment asks: given two sequences (say, a gene from a human and the equivalent gene from a mouse), what is the best way to line them up to reveal their similarities, allowing for insertions, deletions, and substitutions? This matters because evolutionary relationships, shared function, and disease mechanisms are often revealed by how closely sequences match.

The classical solution is dynamic programming: algorithms like Needleman-Wunsch (global alignment) and Smith-Waterman (local alignment) build a scoring matrix cell by cell, where each cell represents the best possible alignment score up to that point, and trace back through it to recover the optimal alignment. This guarantees the mathematically best alignment under a given scoring scheme, but it's computationally expensive — true dynamic programming alignment scales with the product of the two sequence lengths, which is too slow for searching a sequence against an entire genome database.

text

Note

To search a sequence against entire genome databases, exact dynamic programming is too slow. BLAST (Basic Local Alignment Search Tool) uses a heuristic approach instead: it finds short exact-matching seed fragments quickly using lookup tables, then extends only the promising seeds using full alignment scoring. This sacrifices a guarantee of finding the mathematically optimal match in exchange for searching billions of bases in seconds — the same speed-versus-optimality tradeoff seen throughout AI search.

The protein folding problem

A protein is built from a linear chain of amino acids, but it only becomes functional once it folds into a specific three-dimensional shape — and that shape determines almost everything about what the protein does, from catalyzing reactions to binding other molecules. For fifty years, predicting a protein's 3D structure directly from its amino acid sequence (without expensive lab techniques like X-ray crystallography or cryo-electron microscopy) was one of biology's grand unsolved problems, known as the protein folding problem.

The core difficulty is the astronomical number of possible foldings: a modest-sized protein chain has more possible configurations than there are atoms in the observable universe, yet real proteins reliably fold into the same shape in fractions of a second — a paradox (Levinthal's paradox) that hinted the folding process follows strong underlying rules, even if those rules weren't understood well enough to simulate directly.

How AlphaFold cracked it (conceptually)

AlphaFold, developed by DeepMind, achieved a breakthrough at the 2020 CASP competition (the field's standardized blind-test benchmark), reaching prediction accuracy competitive with experimental methods for the first time. At a conceptual level, it works by treating structure prediction as a learned pattern-matching problem rather than a physics simulation: it takes a protein's amino acid sequence, searches large databases for evolutionarily related sequences across many species (a multiple sequence alignment), and uses co-evolutionary signal — the statistical fact that amino acids which end up physically close in the folded structure tend to mutate together across evolutionary history — as a strong clue about which parts of the chain fold near each other.

A deep neural network architecture (built around attention mechanisms similar to those in transformers) processes this evolutionary and geometric information jointly, iteratively refining a 3D structure prediction along with a confidence estimate for each predicted region, rather than simulating the physical folding process step by step.

Experimental vs. computational structure determination

MethodTypical time per structureCostCoverage
X-ray crystallographyWeeks to monthsHigh (equipment, expertise)Requires protein to crystallize — many don't
Cryo-electron microscopyDays to weeksHighBetter for large complexes, still resource-intensive
AlphaFold predictionMinutes to hoursLow (compute only)Any sequence; confidence varies by region

Note

A crucial and often overlooked feature of modern structure prediction tools is that they output per-residue confidence scores alongside the structure itself. Flexible or disordered regions of a protein genuinely don't have one fixed shape, and a trustworthy prediction system has to communicate that uncertainty rather than hiding it — a lesson relevant to AI evaluation generally: a confident-looking wrong answer is often worse than an answer that flags its own uncertainty.

Genomics applications beyond structure

Structure prediction is the highest-profile result, but AI touches most of modern genomics. Variant calling pipelines use machine learning to distinguish real genetic mutations from sequencing errors in raw sequencer output. Gene expression analysis uses clustering and dimensionality reduction (similar to techniques covered in PCA and clustering) to identify cell types from single-cell RNA sequencing data. Drug discovery pipelines use AI models to predict how candidate molecules will bind to a target protein's predicted structure, dramatically narrowing the search space before expensive lab synthesis and testing. And disease risk prediction models combine genomic variants with clinical data to estimate individual risk for conditions with a genetic component.

What's next

AlphaFold's architecture leans heavily on attention mechanisms originally developed for language. The Transformers module covers that underlying architecture in depth — useful context for understanding why the same core idea keeps resurfacing across language, vision, and now biology.

I build these systems professionally.

Whether it's a RAG pipeline, analytics migration, or AI workflow — let's talk.

Need custom AI or MarTech setup? Let's build together.