Lädt...


🔧 Quick tip: Building Predictive Analytics for Loan Approvals


Nachrichtenbereich: 🔧 Programmierung
🔗 Quelle: dev.to

Abstract

In this short article, we'll explore loan approvals using a variety of tools and techniques. We'll begin by analysing loan data and applying Logistic Regression to predict loan outcomes. Building on this, we'll integrate BERT for Natural Language processing to enhance prediction accuracy. To interpret the predictions, we'll use SHAP and LIME explanation frameworks, providing insights into feature importance and model behaviour. Finally, we'll explore the potential of Natural Language processing through LangChain to automate loan predictions, using the power of conversational AI.

The notebook file used in this article is available on GitHub.

Introduction

In this article, we'll explore various techniques for loan approvals, using models like Logistic Regression and BERT, and applying SHAP and LIME for model interpretation. We'll also investigate the potential of using LangChain for automating loan predictions with conversational AI.

Create a SingleStore Cloud account

A previous article showed the steps to create a free SingleStore Cloud account. We'll use the Free Shared Tier and take the default names for the Workspace and Database.

Import the notebook

We'll download the notebook from GitHub.

From the left navigation pane in the SingleStore cloud portal, we'll select DEVELOP > Data Studio.

In the top right of the web page, we'll select New Notebook > Import From File. We'll use the wizard to locate and import the notebook we downloaded from GitHub.

Run the notebook

After checking that we are connected to our SingleStore workspace, we'll run the cells one by one.

We'll begin by installing the necessary libraries and importing dependencies, followed by loading the loan data from a CSV file containing nearly 600 rows. Since some rows have missing data, we'll drop the incomplete ones for the initial analysis, reducing the dataset to around 500 rows.

Next, we'll further prepare the data and separate the features and target variable.

Visualisations can provide great insights into data and we'll begin by creating a heatmap that shows the correlation between numeric-only features, as shown in Figure 1.

Figure 1. Heatmap.

Figure 1. Heatmap.

We can see that the Loan Amount and the Applicant Income are strongly related.

If we plot the Loan Amount against Applicant Income, we can see that most of the data points are towards the bottom left of the scatter plot, as shown in Figure 2.

Figure 2. Scatter Plot.

Figure 2. Scatter Plot.

So, incomes are generally quite low and loan applications are also for fairly small amounts.

We can also create a pair plot for the Loan Amount, Applicant Income and Co-applicant Income, as shown in Figure 3.

Figure 3. Pair Plot.

Figure 3. Pair Plot.

In most cases, we can see that the data points tend to cluster together and there are generally few outliers.

We'll now perform some feature engineering. We'll identify the categorical values and convert these to numerical values and also use one-hot encoding where required.

Next, we'll create a model using Logistic Regression as there are only two possible outcomes: either a loan application is approved or it is denied.

If we visualise the feature importance, we can make some interesting observations, as shown in Figure 4.

Figure 4. Feature Importance.

Figure 4. Feature Importance.

For example, we can see that Credit History is obviously very important. However, Marital Status and Gender are also important.

We'll now make predictions using one test sample.

We'll generate a loan application summary using Bidirectional Encoder Representations from Transformers (BERT) with the test sample. Example output:

BERT-Generated Loan Application Summary

applicant : mr blobby income : $ 7787. 0 credit history : 1. 0 loan amount : $ 240. 0 property area : urban area

Model Prediction ('Y' = Approved, 'N' = Denied): Y
Loan Approval Decision: Approved

Using the BERT generated summary, we'll create a word cloud as shown in Figure 5.

Figure 5. Word Cloud.

Figure 5. Word Cloud.

We can see that the applicant's name, income and credit history are larger and more prominent.

Another way we can analyse the data for our test sample is by using SHapley Additive exPlanations (SHAP). In Figure 6 we can visually see features that are important.

Figure 6. SHAP.

Figure 6. SHAP.

A SHAP force plot is another way we could analyse the data, as shown in Figure 7.

Figure 7. Force Plot.

Figure 7. Force Plot.

We can see how each feature contributes to a particular prediction for our test sample by showing the SHAP values in a visual way.

Another very useful library is Local Interpretable Model-Agnostic Explanations (LIME). The results for this can be generated in the accompanying notebook to this article.

Next, we'll create a Confusion Matrix (Figure 8) for our Logistic Regression model and generate a classification report.

Figure 8. Confusion Matrix.

Figure 8. Confusion Matrix.

The results shown in Figure 8 are a little mixed, but the classification report contains some good results:

Accuracy: 0.84
Precision: 0.83
Recall: 0.98
F1-score: 0.90
Classification Report:
              precision    recall  f1-score   support

           N       0.91      0.49      0.64        43
           Y       0.83      0.98      0.90       109

    accuracy                           0.84       152
   macro avg       0.87      0.74      0.77       152
weighted avg       0.85      0.84      0.82       152

Overall, we can see that using existing Machine Learning tools and techniques gives us many possible ways to analyse the data and find interesting relationships, particularly down to the level of an individual test sample.

Next, let's use LangChain and an LLM and see if we can also make loan predictions.

Once we have set up and configured LangChain, we'll test it with two examples, but restrict access to the quantity of data so that we don't exceed token and rate limits. Here is the first example:

query1 = (
"""
    Build a loan approval model.
    Limit your access to 10 rows of the table.
    Use your model to determine if the following loan would be approved:
    Gender: Male
    ApplicantIncome: 7787.0
    Credit_History: 1
    LoanAmount: 240.0
    Property_Area_Urban: 1
    Limit your reply to either 'Approved' or 'Denied'.
"""
)

result1 = run_agent_query(query1, agent_executor, error_string)
print(result1)

In this case, the application was approved in the original dataset.

Here is the second example:

query2 = (
"""
    Build a loan approval model.
    Limit your access to 10 rows of the table.
    Use your model to determine if the following loan would be approved:
    Gender: Female
    ApplicantIncome: 5000.0
    Credit_History: 0
    LoanAmount: 103.0
    Property_Area_Semiurban: 1
    Limit your reply to either 'Approved' or 'Denied'.
"""
)

result2 = run_agent_query(query2, agent_executor, error_string)
print(result2)

In this case, the application was denied in the original dataset.

Running these queries, we may get inconsistent results. This may be due to restricting the quantity of data that can be used. We can also use verbose mode in LangChain to see the steps being used to build a loan approval model, but there is insufficient information at this initial level about the detailed steps to create that model.

More work is needed with conversational AI, as many countries have fair lending rules and we'd need a detailed explanation about why the AI approved or denied a particular loan application.

Summary

Today, many powerful tools and techniques enhance Machine Learning (ML) for deeper insights into data and loan prediction models. AI, through Large Language Models (LLMs) and modern frameworks, offers great potential to augment or even replace traditional ML approaches. However, for greater confidence in AI's recommendations and to comply with legal and fair lending requirements in many countries, it's crucial to understand the AI's reasoning and decision-making process.

...

🔧 Quick tip: Building Predictive Analytics for Loan Approvals


📈 87.37 Punkte
🔧 Programmierung

🔧 Building Predictive Analytics for Loan Approvals


📈 66.65 Punkte
🔧 Programmierung

🔧 🚀 LoanEase: Simplifying Loan Approvals with Machine Learning


📈 38.27 Punkte
🔧 Programmierung

💾 How is Mudra Loan Different from a Business Loan?


📈 31.22 Punkte
💾 IT Security Tools

📰 5 Best Instant Loan Apps in USA 2022 | $50 Loan Instant App


📈 31.22 Punkte
📰 IT Security Nachrichten

📰 Online Loan Vs In-Person Loan: What’s The Most Secure?


📈 31.22 Punkte
📰 IT Security Nachrichten

🕵️ Oracle Loans 12.1.1/12.1.2/12.1.3 Loan Details/Loan Accounting Events unknown vulnerability


📈 31.22 Punkte
🕵️ Sicherheitslücken

🔧 Navigating the Risky Waters of Loan Defaults: A Predictive Beacon


📈 29.86 Punkte
🔧 Programmierung

🎥 AdMob & Analytics FTW - AdMob Quick Tip #1


📈 28.81 Punkte
🎥 Videos

📰 Von Predictive Maintenance zum Predictive IT-Desaster-Management


📈 28.5 Punkte
📰 IT Nachrichten

🔧 Dev Tip: How to view Dev Tip: How to view localhost web apps on your phone


📈 24.54 Punkte
🔧 Programmierung

📰 Millions Of Bank Loan & Mortgage Docs Leaked Online By 3rd Party Analytics Firm Ascension


📈 23.7 Punkte
📰 IT Security Nachrichten

📰 Millions Of Bank Loan & Mortgage Docs Leaked Online By 3rd Party Analytics Firm Ascension


📈 23.7 Punkte
📰 IT Security Nachrichten

📰 Millions Of Bank Loan & Mortgage Docs Leaked Online By 3rd Party Analytics Firm Ascension


📈 23.7 Punkte
📰 IT Security Nachrichten

📰 Signifyd unveils tool that enhances authorization-stage order approvals for retailers


📈 22.66 Punkte
📰 IT Security Nachrichten

📰 Master Your PCI DSS v4 Compliance with Innovative Smart Approvals


📈 22.66 Punkte
📰 IT Security Nachrichten

🕵️ Best Practical Request Tracker up to 3.8.14 Approvals ShowPending sql injection [Disputed]


📈 22.66 Punkte
🕵️ Sicherheitslücken

📰 China Is Backing Off Coal Power Plant Approvals


📈 22.66 Punkte
📰 IT Security Nachrichten

📰 Facebook Improves Account Security, Introduces Login Approvals


📈 22.66 Punkte
📰 IT Security Nachrichten

🕵️ CVE-2024-21132 | Oracle Purchasing up to 12.2.13 Approvals improper authorization


📈 22.66 Punkte
🕵️ Sicherheitslücken

📰 Facebook Improves Account Security, Introduces Login Approvals


📈 22.66 Punkte
📰 IT Security Nachrichten

🔧 How to Use Virtual Reality for Client Walkthroughs and Approvals


📈 22.66 Punkte
🔧 Programmierung

🎥 Approvals in Jira | Atlassian


📈 22.66 Punkte
🎥 Video | Youtube

📰 New US Immigration Rules Spur More Visa Approvals For STEM Workers


📈 22.66 Punkte
📰 IT Security Nachrichten

🎥 Approvals in Jira Work Management | Atlassian


📈 22.66 Punkte
🎥 Video | Youtube

🪟 OnPodcast Ep. 110: Windows vs MacOS, more Activision approvals, and Musk vs Microsoft


📈 22.66 Punkte
🪟 Windows Tipps

🪟 Microsoft: Bing is still in preview despite recent accelerated waitlist approvals


📈 22.66 Punkte
🪟 Windows Tipps

📰 'Classifying Aging as a Disease Could Speed FDA Drug Approvals'


📈 22.66 Punkte
📰 IT Security Nachrichten

🪟 Xbox Chaturdays 81: New acquisition approvals and Overwatch 2 controversies with Rand al Thor 19


📈 22.66 Punkte
🪟 Windows Tipps

📰 CASA to trial automated digital approvals for commercial drone operators


📈 22.66 Punkte
📰 IT Nachrichten

matomo