I am creating Custom Designs list view Extension with integration of card view and recycler view

You don't need to add the cardview and recyclerview libraries with the extension. AI2 already has them built-in. (See here)
You need to drag & drop the ListView component and make it invisible.

I recommend you to use the new and improved extension builder FAST CLI.