The core barrel with roller bits is a common drilling tool for rotary drilling into rock. In order to solve the problem of difficulty and low efficiency in rock drilling, this paper analyzes the movement mode and rock breaking mechanism of the core barrel with roller bits. In the structural design of the core barrel with roller bits, the focus should be put on the arrangement and placement angle of the roller bits, and the selection of the carbide teeth, as well as the locking method of the replaceable rollers and the structural characteristics of the reaming core barrel. This paper presents the structure of core barrel with roller bits suitable for rotary drilling which has achieved good results in the production test.