On the Paradox of Learning to Reason from Data

Created: 2022-10-24T09:31:15-05:00

Return to the Index

This card pertains to a resource available on the internet.

• BERT appears to learn to solve logical problems but actually only can do it on the training data
• Logic problems often have statistical solutions
• These statistical solutions are valid for a given domain but are not proper logical deductions
• BERT learns these statistical answers for what its trained but does not learn formal logic