Section 5: Classification with More than Two Classes and the Caret Package

In the Classification with More than Two Classes and the Caret Package section, you will learn how to overcome the curse of dimensionality using methods that adapt to higher dimensions and how to use the caret package to implement many different machine learning algorithms.

After completing this section, you will be able to:

This section has three parts:

  1. Classification with more than two classes
  2. The Caret Package
  3. Set of exercises on the Titanic

5.1 Classification with more than two classes

5.1.1 Trees Motivation

5.1.2 Classification and Regression Trees (CART)

5.1.3 Classification (Decision) Trees

5.1.4 Random Forests

5.1.5 Comprehension Check: Trees and Random Forests

5.2 The Caret Package

5.2.1 The Caret Package

5.2.2 Tuning Parameters with Caret

5.2.3 Comprehension Check: Caret Package

5.3 Set of exercises on the Titanic

5.3.1 Titanic Exercises, Part 1

5.3.2 Titanic Exercises, Part 2

LS0tDQp0aXRsZTogJ0RhdGEgU2NpZW5jZTogTWFjaGluZSBMZWFybmluZyAtIEhhcnZhcmRYOiBQSDEyNS44eCcNCmF1dGhvcjogIlJlemEgSGFzaGVtaSINCmRhdGU6ICIwOC0xMi0yMDE5Ig0Kb3V0cHV0Og0KICBwZGZfZG9jdW1lbnQ6IGRlZmF1bHQNCiAgaHRtbF9ub3RlYm9vazogZGVmYXVsdA0KLS0tDQoNCmBgYHtyIGluY2x1ZGU9RkFMU0V9DQojIFNldCBrbml0ciBvcHRpb25zIGZvciBrbml0dGluZyBjb2RlIGludG8gdGhlIHJlcG9ydDoNCiMgLSBlY2hvPVRSVUU6IHByaW50IG91dCBjb2RlIChlY2hvKSwgdGhvdWdoIGFueSByZXN1bHRzL291dHB1dCB3b3VsZCBzdGlsbCBiZSBkaXNwbGF5ZWQNCiMgLSBjYWNoZT1UUlVFOiBTYXZlIHJlc3VsdHMgc28gdGhhdCBjb2RlIGJsb2NrcyBhcmVuJ3QgcmUtcnVuIHVubGVzcyBjb2RlIGNoYW5nZXMgKGNhY2hlKSwNCiMgX29yXyBhIHJlbGV2YW50IGVhcmxpZXIgY29kZSBibG9jayBjaGFuZ2VkIChhdXRvZGVwKSwgYnV0IGRvbid0IHJlLXJ1biBpZiB0aGUNCiMgb25seSB0aGluZyB0aGF0IGNoYW5nZWQgd2FzIHRoZSBjb21tZW50cyAoY2FjaGUuY29tbWVudHMpDQojIC0gbWVzc2FnZSwgd2FybmluZyA9IEZBTFNFOiBEb24ndCBjbHV0dGVyIFIgb3V0cHV0IHdpdGggbWVzc2FnZXMgb3Igd2FybmluZ3MNCiMgVGhpcyBfd2lsbF8gbGVhdmUgZXJyb3IgbWVzc2FnZXMgc2hvd2luZyB1cCBpbiB0aGUga25pdHRlZCByZXBvcnQNCiMgLSByZXN1bHRzPSJoaWRlIjogaGlkZSB0aGUgcmVzdWx0cy9vdXRwdXQgKGJ1dCBoZXJlIHRoZSBjb2RlIHdvdWxkIHN0aWxsIGJlIGRpc3BsYXllZCkNCiMgLSBpbmNsdWRlPUZBTFNFOiAgY2h1bmsgaXMgZXZhbHVhdGVkLCBidXQgbmVpdGhlciB0aGUgY29kZSBub3IgaXRzIG91dHB1dCBpcyBkaXNwbGF5ZWQNCiMgLSBldmFsPUZBTFNFOiBjaHVuayBpcyBub3QgZXZhbHVhdGVkDQprbml0cjo6b3B0c19jaHVuayRzZXQoZWNobz1UUlVFLA0KICAgICAgICAgICAgICAgY2FjaGU9VFJVRSwgYXV0b2RlcD1UUlVFLCBjYWNoZS5jb21tZW50cz1GQUxTRSwNCiAgICAgICAgICAgICAgIG1lc3NhZ2U9RkFMU0UsIHdhcm5pbmc9RkFMU0UpDQpgYGANCg0KIyBTZWN0aW9uIDU6IENsYXNzaWZpY2F0aW9uIHdpdGggTW9yZSB0aGFuIFR3byBDbGFzc2VzIGFuZCB0aGUgQ2FyZXQgUGFja2FnZQ0KDQpJbiB0aGUgKipDbGFzc2lmaWNhdGlvbiB3aXRoIE1vcmUgdGhhbiBUd28gQ2xhc3NlcyBhbmQgdGhlIENhcmV0IFBhY2thZ2UqKiBzZWN0aW9uLCB5b3Ugd2lsbCBsZWFybiBob3cgdG8gb3ZlcmNvbWUgdGhlIGN1cnNlIG9mIGRpbWVuc2lvbmFsaXR5IHVzaW5nIG1ldGhvZHMgdGhhdCBhZGFwdCB0byBoaWdoZXIgZGltZW5zaW9ucyBhbmQgaG93IHRvIHVzZSB0aGUgY2FyZXQgcGFja2FnZSB0byBpbXBsZW1lbnQgbWFueSBkaWZmZXJlbnQgbWFjaGluZSBsZWFybmluZyBhbGdvcml0aG1zLg0KDQpBZnRlciBjb21wbGV0aW5nIHRoaXMgc2VjdGlvbiwgeW91IHdpbGwgYmUgYWJsZSB0bzoNCg0KKiBVc2UgKipjbGFzc2lmaWNhdGlvbiBhbmQgcmVncmVzc2lvbiB0cmVlcyoqLg0KKiBVc2UgKipjbGFzc2lmaWNhdGlvbiAoZGVjaXNpb24pIHRyZWVzKiouDQoqIEFwcGx5ICoqcmFuZG9tIGZvcmVzdHMqKiB0byBhZGRyZXNzIHRoZSBzaG9ydGNvbWluZ3Mgb2YgZGVjaXNpb24gdHJlZXMuIA0KKiBVc2UgdGhlICoqY2FyZXQqKiBwYWNrYWdlIHRvIGltcGxlbWVudCBhIHZhcmlldHkgb2YgbWFjaGluZSBsZWFybmluZyBhbGdvcml0aG1zLg0KDQpUaGlzIHNlY3Rpb24gaGFzIHRocmVlIHBhcnRzOiANCg0KIDEuICoqQ2xhc3NpZmljYXRpb24gd2l0aCBtb3JlIHRoYW4gdHdvIGNsYXNzZXMqKiANCiAyLiBUaGUgKipDYXJldCoqIFBhY2thZ2UNCiAzLiBTZXQgb2YgZXhlcmNpc2VzIG9uIHRoZSBUaXRhbmljDQogDQojIyA1LjEgQ2xhc3NpZmljYXRpb24gd2l0aCBtb3JlIHRoYW4gdHdvIGNsYXNzZXMNCiANCiMjIyA1LjEuMSBUcmVlcyBNb3RpdmF0aW9uDQogDQojIyMgNS4xLjIgQ2xhc3NpZmljYXRpb24gYW5kIFJlZ3Jlc3Npb24gVHJlZXMgKENBUlQpDQogDQojIyMgNS4xLjMgQ2xhc3NpZmljYXRpb24gKERlY2lzaW9uKSBUcmVlcw0KIA0KIyMjIDUuMS40IFJhbmRvbSBGb3Jlc3RzDQogDQojIyMgNS4xLjUgQ29tcHJlaGVuc2lvbiBDaGVjazogVHJlZXMgYW5kIFJhbmRvbSBGb3Jlc3RzDQogDQogDQojIyA1LjIgVGhlIENhcmV0IFBhY2thZ2UNCiMjIyA1LjIuMSBUaGUgQ2FyZXQgUGFja2FnZQ0KIyMjIDUuMi4yIFR1bmluZyBQYXJhbWV0ZXJzIHdpdGggQ2FyZXQNCiMjIyA1LjIuMyBDb21wcmVoZW5zaW9uIENoZWNrOiBDYXJldCBQYWNrYWdlDQogDQojIyA1LjMgU2V0IG9mIGV4ZXJjaXNlcyBvbiB0aGUgVGl0YW5pYw0KIyMjIDUuMy4xIFRpdGFuaWMgRXhlcmNpc2VzLCBQYXJ0IDENCiMjIyA1LjMuMiBUaXRhbmljIEV4ZXJjaXNlcywgUGFydCAy