Hi @Zebra067 ,
I am sorry if I am being dumb but I am not sure I totally understand what you are trying to achieve. Can you describe your application, maybe create the layout with buttons and then describe what you want them to do? 
Without fully understanding your need could I suggest you might consider just creating your own matrix of buttons using discreet button objects and placing them in an lv_obj_t, would that enable you to more easily achieve your goals? There is no performance penalty I can think of if you do things this way, as long as you stick to the concepts we have discussed previously.
Kind Regards,
Pete