In this article, we present a geometric theoretical analysis of semidefinite feasibility problems (SDFPs). We introduce the concept of hyper feasible partitions and sub-hyper feasible directions, and show how they can be used to decompose SDFPs into smaller ones, in a way that preserves most feasibility properties of the original problem. With this technique, we develop a detailed analysis of weakly infeasible SDFPs to understand clearly and systematically how weak infeasibility arises in semidefinite programming.